A/B Testing Dilrukshi Adam Rahul
A/B Testing on the prototpe
- Dilrukshi @dilrukshi
- Adam @aginzberg
- Rahul @rahulseth1016
- Rashmi @rashmi_puttur
A/B testing is simply (sometimes called split testing) is comparing two versions of a web page to see which one performs better. You compare two web pages by showing the two variants (let's call them A and B) to similar visitors at the same time. The one that gives a better conversion rate, wins!
A/B test plan
We initially brainstormed the problems occurred in the usability tests. A/B test focused on the "create project" 6 step process.
"Initial pages "
Problematic pages are 2nd - Project Details 4th - Design Task and 5th - Payment tab
Proposed alternative designs for 2nd step- Project details
Proposed designs for 2nd step - Project details
Results of the A/B test in 2nd Step - Project details with Prototype A B C
The results of the Prototype A B C for Detail project has same issues as initial prototypes. Still it made the users confusing to identify what is the purpose of how many times and multiple inputs. We have many alternative ideas for language in the userresearch channel, yet we could not come to an effective design which makes the user easy to understand the meaning of it.
If you visit these two slides, it will be easy for you to follow the changes we planed and alternatives we tried. Produced by Rahul (#rahulseth1060) This link has a alternative ideas for 2nd 4th and 5th steps - specially 4th step of design Task - https://docs.google.com/presentation/d/1dzUDj8dTuscXN663QrRY45TgGiYCvOjMSxU91vepysM/edit?usp=sharing
This link has the plan of A/B testing and approach for 2nd step - project details - https://docs.google.com/presentation/d/1cLNFed0mr_eZ4w-BZ4aNK657PvG-Vm1NwwcbiW-ToJ4/edit?usp=sharing
Proposed alternative designs for 4rth step- Design task
We found that the fourth page of the Create a Task design was very problematic as many people didn't understand the purpose of the Design a Task Page. To solve this issue, we propose to include a page prior to this which is an example design of a task. We believe that this will help out the people understand how to design a task, making the interface more efficient as a whole. We are yet to test it with users to get the feedback.
Since the alternative prototypes failed to meet the useability, we are in a process of radical change to the process 6 step to 3 step model providing examples to assist when users fill the details.
For example - when the user select the category - depend on the category they will be assist by the interface giving examples.
Adam (@aginzberg) and Dilrukshi(@dilrukshi) are working on it and will produce some sketch and results soon as we get it.
Rashmi(@rashmi_puttur) is working on the functionality side of the design to test with few users