Testing Plan for 3.4 release

Create Webtests for bugs that were fixed in 3.4.6 / 4.0.6 release

These tests should be added to the 3.4 branch and run from there.
Deadline Tuesday 10/4
Note: Many of these can be tested by modifying or extending existing tests.

CiviEvent Issues

• Participant Role selection via Profile in Event Registration is ignored CRM-8854 Michal
• Display all events that have not ended, and do not display past or disabled events CRM-5133 and CRM-8620 deepak
• Error after mass subscribe contacts to an event CRM-8607 yashodha

CiviMember Issues

• New membership should be created (rather than renewal) if user purchases membership in a different membership organization than their existing membership(s) – ----CRM-8141- Dave
• Batch update membership status via profile fails CRM-8618 Dave
• (this is a 4.1 issue) Renew for > 1 term CRM-8750 Dave
• Start date set to 0 for new memberships by relation CRM-8605 ashwini

Search-related Issues

• Error when searching for related contacts CRM-7969 rohan
• "Deceased" advanced search does not apply to group removal CRM-8003 ashwini
• Actions from 'Display results as related contacts search' are carried out on original, not related contacts CRM=7948 rajan

Leftover from 3.4.1 cycle

• A newline in a Campaign description breaks the Campaign Dashboard CRM-8030 Pratik
• Relationship types are not inherited form contact types to sub-types CRM-7942 Pratik
• WSOD when forwarding emails CRM-7989 Rajan

Create Webtests for bugs that were fixed in 3.4.1 / 4.0.1 release

Deadline 5/11

Note: Many of these can be tested by modifying or extending existing tests.

• Pledge payment status and pledge status are not being updated when a pledge payment is made CRM-8045
• Fatal error when no contact selected on New Case form CRM-7971 - Dave
• Full-screen mode for dashlets CRM-7796 - Dave
• Quick search broken if partial match string entered CRM-7946 - Dave

Kurund - please assign these to India team members - Done

• Pager on Donor Detail Report resets search criteria CRM-8004 - Kurund
• Make sure expected group types are available and can be assigned to groups in New Group / Group Settings form CRM-7955 - Neha
• Price Set Custom Search Returns Extra Participants CRM-7953 -  Rajan
• Batch Update via Profile: Update membership records destroys membership end_date data CRM-7986 - Ashwini
• Groups checkbox not rendering on Profile create / edit forms CRM-8015 - Kurund
• 'Max Participants' for price set field does NOT work CRM-7983 -  Rajan
• Unchecking "Enabled" flag for a relationship should delete membership inherited by that relationship CRM-7985 - Yashodha
• Activity custom data is lost when an activity is filed to a case CRM-7968 - Ashwini
• Find duplicates includes deleted contacts in results CRM-8005 - Neha
• Pending Pay Later contribution with Separate Membership Contribution & Fixed Contribution Options gives New membership CRM-7949 - Yashodha
• Contribution page with separate contribution and membership payments gives error if no payment processor CRM-7943 - Dakshayani
• Email signature webtest for contacts CRM-8048 - Nitesh
• Advance search panes CRM-7225 -  Rajan

Fix failing tests

Goal

• Fix broken BAO test
• Fix broken Webtest
• Fix broken api test

All the below work should be committed under CRM-7523

Deadline: Before alpha

Add new Webtests

Deadline: Before stable or immediately after stable

• Import Activities ( Neha )
• Add to new group and add to existing group ( Dakshayani )
• Create tag and use existing tag ( Nitesh )
• Create multiple relationships during same import:( Rajan )
  • Employer Org Name, Street Address, City, State
  • Spouse First, Last, Email, Street Address, City, State
• Custom data - date, radio, multi-select, contact reference fields ( Ashwini )
• Duplicate Matching (existing contacts): skip, update, fill, no dupe checking. ( Rajan )
• Address parsing enabled ( pradeep )
• Saved import mapping ( Pradeep )
• Contact subtype import ( Poonam )
• Import Contributions, Participants, Memberships, Activities - match on external ID ( Neha )
• Contact Import - match on custom field added to strict dedupe ( Ashwini )
• Various date formats (default, US-mm/dd/yy, and UK/India-dd/mm/yy)  for import ( Poonam )

Deadline: Before stable

• Survey - extend SurveyUsageTest.php ( CRM-7876 ) ( Ashwini )
  • include core Phone field in profile created for the survey
  • run Survey Detail report for this survey and check "print" version for profile fields (s/b report columns) and result set codes
  • after interviewing respondent and find / verify contents of completed survey activity from Find Activities (should have activity with subject = "$surveyTitle - Respondent Interview")
  • repeat Reserve Respondents and Interview Respondents steps using Ajaxified workflow ("Conduct Survey" menu item - civicrm/campaign/vote)
  • Reserve Respondents from civicrm/survey/search?reset=1&op=reserve and then use GOTV (campaign/gotv) to mark them as voted. (Activity for this flow will still have subject = "$surveyTitle - Respondent Reservation", this is ok for now).
• Membership signup (offline) calculations with fixed membership periods, before and after rollover date (test cases in CRM-7825) ( Ashwini )
• UpdateMembership script
  • create membership with stale status: join date=Mar 1, 2008; Status override=checked; Status=Current
  • unset status_override in DB (may need new webtest helper for this?)
  • run UpdateMembership script and verify that membership status is updated to Expired
• Merge contacts (including making sure dupe contact is moved to trash) ( Ashwini )
• Import contacts (w/ standard csv file) ( Rajan )
• Import participants ( Rajan )
• Import contributions ( Neha )
• Import memberships ( Ashwini )
• Change participant status (task action from Find Participants) ( Ashwini )
• Price-sets (Yashodha )
  • Admin-only price fields (verify they don't show for online registration; verify back-office functionality create and update, submit credit card registration)
  • Date-specific price fields (online registration; back-office)
  • Price-set for contributions (online contribution page; back-office create and update)
• PCP (Sushant)
  • Create new contrib page and enable PCP
  • anon user creates PCP and admin approves
  • anon user contributes via PCP and verify contribution and soft credit
• Event wait list (online register to wait list status when event is full) ( Neha )
• Tell-a-Friend functionality for events( Ashwini )
  • enable and modify default messages
  • register online as anonymous and fill-in Tell-a-Friend form with additional messaging for recipients
  • login and verify tell-a-friend recipient contact created with tell-a-friend activity shown for both sender and recipient
• CiviMail (create mailing w/ existing message template with tokens, run mail/queue and verify mailing status = Completed, check for bulk mailing in a recipient contact activity tab and check for evaluated tokens via View activity) (Sushant)
• Upgrade web tests - CRM-7521 - michal

Deadline: Before beta

• CRM-7475 Create unit test and web test for Membership Upsell feature - Neha
• Dedupe - Neha
• Offline recurring contribution - Dave ( CRM-7664 )
• Online recurring contribution - Dave ( CRM-7664 )
• Online auto renew membership - Kiran ( CRM-7659 )
• Offline auto renew membership - Deepak
• Auto adjust pledge feature - Sushant
• Campaign connectivity with other components - Ashwini ( CRM-7773 )
• Shared household address feature - Kurund
• Participant count feature - Rajan

Need to investigate / work on following issues ( Need to discuss on below issues with Michal )

• CRM-7216 Reinstall code coverage reports - Kurund
• CRM-7219 Describe and start introducing the procedure for tests accompanying patches and contributions - Kurund
• CRM-7506 Start running CiviCRM tests on Supercell - Michal
• CRM-7521 Automate release testing process - Michal
• CRM-7222 Automatically publish statistics of tests runs and diffs between runs - Michal

Deadline: Ongoing