Question
Asked 11th Jun, 2016

How test a new text input method for usability?

I developed a new text input mechanism for Sinhala (A popular language used in Sri Lanka). The prototype was built for an android touch screen device. I would like to know the options I have for usability testing. Any tests I can carry out based on the cognitive system is preferred.

Most recent answer

Tulakshana Weerasooriya
University of Moratuwa
@Carl, why do you think people who take online surveys are upset?

Popular answers (1)

Wiktoria Wilkowska
RWTH Aachen University
Hello Tulakshana,
if you need a quick and dirty”, reliable tool for measuring the usability and the learnability of your new mechanism on the android you can use the "System Usability Scale" (Brooke). From my experience, it is a short and effective measurement scale; you may only have to rephrase a bit.
If you want to see a short description, here is a link: 
Kind regards,
Wiktoria
3 Recommendations

All Answers (9)

Behzad Soleimani Neysiani
Oil Design&Construction Company (ODCC)
Hi dear
What is the meaning of new mechanism? Do you mean, you develop new layout for keyboard? Or implement new character map for Unicode of Sinhala?
If you mean a new layout, a good layout should be designed based on frequency of character using. e.g. in English language, characters such as a e i o u are very frequent, so the place of these characters in keyboard designed to be easy for use. You could process some general books context in Sinhala language and count frequency of characters, then based on the frequency of characters, design your keyboard layout.
With Regards
1 Recommendation
Wiktoria Wilkowska
RWTH Aachen University
Hello Tulakshana,
if you need a quick and dirty”, reliable tool for measuring the usability and the learnability of your new mechanism on the android you can use the "System Usability Scale" (Brooke). From my experience, it is a short and effective measurement scale; you may only have to rephrase a bit.
If you want to see a short description, here is a link: 
Kind regards,
Wiktoria
3 Recommendations
Seungyup Lee
Yonsei University
Dear Tylakshana, 
I understood your question that you want to know about any types of possible empirical test. If so, you can test your prototype in two perspectives. Firstly, you can measure the task performance of the users. For example, for the given text entry, you can measure the time for typing given text with your prototype, and then you can compare the result with the conventional keyboards. During such experiment, you can also measure the typographical error rate for each participant. Secondly, you also can measure some emotional and ergonomic factors of the users. For example, ease of use and physical fatigue may be measured with a questionnaire after the experiment.
3 Recommendations
Ahmad Syawal Mohd Lajis
KDU University College
You can use LUND usability testing, 
Lund, A.M. (2001) Measuring Usability with the USE Questionnaire. STC Usability SIG Newsletter, 8:2
1 Recommendation
It is good practice to measure BOTH user performance AND satisfaction.  If you measure only satisfaction, you are likely to overlook performance issues.  As Wickens and Andre (1995) say, users often like design features that are not supportive of performance, such as overuse of color. 
1 Recommendation
George Adamides
Agricultural Research Institute Cyprus
Hi
You can prepare a quick test and ask participants to input a paragraph using an existing (standard) text input mechanism and the same paragraph using your proposed input mechanism and  after each task, ask this question Overall, this task was? see http://www.measuringu.com/blog/single-question.php  for more details
1 Recommendation
Carl J. Mueller
Texas A&M - Central Texas
Good question.
As Elizabeth said, the best practice is to measure both satisfaction and performance. It also matters how these measures are evaluated and the demographics of the subjects. The issue with subjective questionnaires and interviews is that people lie. In some cases it is considered being polite, since you honored them by including them in the survey they will say only positive. On-line surveys tend to produce negative results because the most people taking the survey are upset. Another issue with the subjective approach is the population necessary for the study. Typically a subjective approach requires 40 or more subjects before the data begins to approach the actual mean.
Another approach is performing a comparative test and use statistical results for performance comparision. It is a simple test to construct, but the primary issue is the math. Measuring human performance is an exercise in measuring learning. Human learning is most accurately modeled by either an exponential decay curve or a power law decay curve. Meaning that it is necessary to use parametric and non-parametric statistics. The good news is that it only requires 7 to 10 cases with 14 to 20 subjects (7 to 10 for each data entry method).  The details of  this approach are documented in An Economical Approach to Usability Testing”, Proceedings of 33rd Annual IEEE International Computer Software and Applications Conference (Compsac 2009), Seattle, WA.
Good Luck.
Tulakshana Weerasooriya
University of Moratuwa
@Carl, why do you think people who take online surveys are upset?

Similar questions and discussions

Recommendations

Conference Paper
Through research on software testing model selection, seeking the most appropriate testing method to achieve most reasonable testing volume and optimal testing result. Described in detail about the core content of Yin-Yang software testing theory; According to research data of Software Productivity Research, U.S.A, with overall consideration about...
Article
Software systems are often complex in the number of fea- tures that are available through the user interface and con- sequently, the number of interactions that can occur. Such systems are prone to errors when interactions do not work as anticipated. This research introduces a combinatorial method for setting up task-based usability tests. The meth...
Conference Paper
The assessment of software systems often requires to consider together qualitative and quantitative aspects. Because of the different nature, measures belong to different domains. The main problem is to aggregate such information into a derived measure able to provide an overall estimation. This problem has been traditionally solved trough the tran...
"To lead my own group is a fantastic opportunity!" Clio Azina, Ph.D. is a new Junior Principal Investigator Fellow at RWTH Aachen University
Sponsored Content
Cypriot Clio Azina came to RWTH in August 2020 as a Marie Skłodowska-Curie Fellow and is now a Junior Principal Investigator Fellow. We asked her about her start in Aachen in view of the coronavirus restrictions and her expectations for her time at RWTH.
Welcome to RWTH Aachen University. We are delighted to have you here as an international researcher for our Junior Principal Investigator fellowships. We would like to get to know you a little better!
Thank you for having me! I am very happy to be here!
You are from Cyprus, you studied in France, earned part of your doctorate in the USA, and then did post-doctoral research in Sweden. What inspired you to apply for a JPI fellowship at RWTH?
I am actually both Cypriot and French. I grew up in Cyprus and went to a Greek school but I had been travelling to France for the summer since very young and had always planned to study there since French is also my mother tongue.
During my Master’s degree I was approached for a Ph.D. program which was to be carried out between the University of Bordeaux, where I was studying at the time, and the University of Nebraska-Lincoln in the USA. It seemed like the perfect opportunity to travel and experience a different culture. I also believe I wanted to do this program not only because I was interested in the project and excited about the research, but also because I wanted to experience a different research and educational environment.
During my last year of Ph.D. I wanted to explore a different field and started sending out emails for post-docs several months before my defence so that I would have time to apply for funding if it was needed. I was very excited to go to Linköping University in Sweden! I really enjoyed my time there, not only because Sweden is a beautiful country but also because I was a post-doc. That meant being treated somewhat differently than before. I was trusted with more responsibilities, I was encouraged to develop my own ideas and I was also promoted and sent to various conferences and workshops to extend my network. That’s how I met Professor Jochen Schneider, actually.
After meeting several times at conferences and meetings, seeing what his group was working on and his approach to research, I almost immediately knew that I wanted to come to Aachen and join his group! Also, the reputation of RWTH as one of the best technical universities in Europe and the support it offers its early career researchers played important roles in this decision.
So, to join RWTH, the first step was applying for the IUVSTA Scholarship, then I applied for a Marie Skłodowska-Curie Fellowship. Both applications were successful and I was delighted to work at Materials Chemistry. When I found out about the JPI Fellowships through ResearchGate last January, applying for the JPI was taking it a step further. Being able to lead my own group is a fantastic opportunity! I am given all the tools and most importantly the guidance that I need to grow into an independent researcher and successful leader. This is what drew me most to the JPI fellowship. It is an intermediate step, before competing for professorships, where you get to experiment with ideas and develop soft skills under the careful eye of the mentor you chose. The feedback you receive is very valuable for professional growth.
The support that RWTH is giving to its JPI fellows was also a motivation for it: the numerous workshops, individual coaching and, of course, the funding that comes with the position are of great importance. I am so excited about having the flexibility and freedom to develop my own research line while also supervising my first Ph.D. student!
How did you arrive in Aachen under the difficult conditions of the pandemic and what is your first impression of the city?
I didn’t have any problems arriving in Aachen, I had problems leaving Aachen! I was actually in Aachen for a three-month stay at Materials Chemistry (Professor Jochen Schneider) with the IUVSTA Medard W. Welch International Scholarship that I was awarded in 2019.
I arrived in January 2020 and was planning on returning to Sweden at the end of March, however, my three-month stay became a five-month stay because of the pandemic. I was unable to travel until mid-May since all the flights I had booked were cancelled one after the other. I finally managed to return to Sweden and had barely more than a month to finish up my work, pack my office and apartment and return to Aachen. I was back in July and the situation had calmed down slightly. I still quarantined for two weeks as a precaution which was also the perfect time to get settled in.
As for my first impressions of the city, I think Aachen is a lovely place! I particularly enjoy the cosy city centre and the nature surrounding it. I am now waiting for the weather to get a bit better so that I can keep exploring!
The JPI Fellowship Program is intentionally coupled with a Profile Area of RWTH. The aim of the program is for the researcher to develop a T-shaped profile at RWTH and to expand interdisciplinary collaborations within the University. Which Profile Area are you working in and what advantages does this have for your current research project?
Indeed, the JPI fellowship opens so many doors for interdisciplinary collaborations within RWTH, which is great for early career researchers like me. I am working within the Materials Science & Engineering (MatSE) Profile Area and hosted at Materials Chemistry.
MatSE offers access to a wide range of techniques for developing and analyzing my materials but also allows me to expand my network by exchanging and interacting with researchers, staff and students from different faculties. Also, the project that I am developing will greatly benefit from interactions with the Molecular Science & Engineering (MSE) and Medical Science & Technology (MedST) Profile Areas, as well as Forschungszentrum Jülich through the JARA (Jülich Aachen Research Alliance) program.
Another great aspect of the profile areas and ultimately RWTH as a whole, is the support given for technological transfer of basic, fundamental research. Indeed, as a material scientist, the aim is to, sooner or later, see the materials that we develop in the lab, being used on a day-to-day basis. I think the JPI fellowship will indeed allow me to develop a T-shaped profile but also the soft skills that I need for advancing my career.
Please note: RWTH is now inviting excellent and experienced early career researchers to apply for six Junior Principal Investigator Fellowships.
Applications are accepted until February 9, 2021.
RWTH is inviting excellent and experienced early career researchers to apply for 6 Junior Principal Investigator (JPI) fellowships
Sponsored Content
The program is designed to attract and support stellar researchers with international experience. Applications from women as well as others whose background and experience enrich the culture of the university are particularly encouraged. Support will be provided for a period of four years, with an optional fifth year.
Call for Applicants - RWTH Junior Principal Investigator Fellowships 2021
An exceptional possibility for young researchers to sharpen their research profile:
JPIs will have the chance to develop a T-shaped profile, build strong (international) networks, shape emerging fields and produce high-impact publications
JPIs are expected to take advantage of the unique opportunities provided by the University's Profile Areas and strategic alliances
JPIs are expected to help foster new interdisciplinary collaborations
Benefits include:
Successful candidates will be employed as junior research group leaders
Additional funding for one full-time doctoral candidate and a budget for consumables
Opportunity to supervise doctoral candidates
Mentoring and career development support through the University’s Advanced Talents program offered by the RWTH Center for Young Academics
Access to the shared cutting-edge research infrastructure in the Profile Area
General RWTH services including access to child care and other resources offered by the Family Services Center.
Interested to shape the future?
Got a technical question?
Get high-quality answers from experts.