Instructions/Requirements for Describing Functionality (Click to expand)

Instructions for Survey

In this HIT, you will be shown 11 pairs of screenshots and accompanying descriptions of these screenshots. These descriptions may either describe the functionality implemented by an entire screen (e.g., "This app displays a login page for a weather app"), or by specific components on the screen (e.g., "There is a gear icon in the top left corner of screen to access settings").

Your goal is to provide feedback about how well the description describes the functionality of the paired screenshots. You will provide feedback for each screenshot-description pair in two ways. First you will answer a series of three multiple choice requestions that will allow you to rate the accuracy, informaiton, understandability of the description in describing the functionality of the screenshot. Second, you will answer a set of three free form questions to provide some information regarding the accuracies and inaccuracies of the description as well as suggestions for improvements.

*Note that you must provide valid responses to the free form text questions in order for the HIT to be accepted.

   NOTE: If this is your first time completing this HIT, please read the instructions by clicking the blue bar above.

Screenshot Description #1

${desc1}

Rate Screenshot Description #1

1. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

2. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

3. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #1 Feedback

4. What aspects of this description are accurate?

5. What aspects of this description are NOT accurate?

6. How could this description be improved?

Screenshot Description #2

${desc2}

Rate Screenshot Description #2

7. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

8. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

9. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #2 Feedback

10. What aspects of this description are accurate?

11. What aspects of this description are NOT accurate?

12. How could this description be improved?

Screenshot Description #3

${desc3}

Rate Screenshot Description #3

13. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

14. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

15. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #3 Feedback

16. What aspects of this description are accurate?

17. What aspects of this description are NOT accurate?

18. How could this description be improved?

Screenshot Description #4

${desc4}

Rate Screenshot Description #4

19. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

20. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

21. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #4 Feedback

22. What aspects of this description are accurate?

23. What aspects of this description are NOT accurate?

24. How could this description be improved?

Screenshot Description #5

${desc5}

Rate Screenshot Description #5

25. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

26. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

27. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #5 Feedback

28. What aspects of this description are accurate?

29. What aspects of this description are NOT accurate?

30. How could this description be improved?

Screenshot Description #6

${desc6}

Rate Screenshot Description #6

31. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

32. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

33. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #6 Feedback

34. What aspects of this description are accurate?

35. What aspects of this description are NOT accurate?

36. How could this description be improved?

Screenshot Description #7

${desc7}

Rate Screenshot Description #7

37. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

38. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

39. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #7 Feedback

40. What aspects of this description are accurate?

41. What aspects of this description are NOT accurate?

42. How could this description be improved?

Screenshot Description #8

${desc8}

Rate Screenshot Description #8

43. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

44. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

45. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #8 Feedback

46. What aspects of this description are accurate?

47. What aspects of this description are NOT accurate?

48. How could this description be improved?

Screenshot Description #9

${desc9}

Rate Screenshot Description #9

49. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

50. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

51. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #9 Feedback

52. What aspects of this description are accurate?

53. What aspects of this description are NOT accurate?

54. How could this description be improved?

Screenshot Description #10

${desc10}

Rate Screenshot Description #10

55. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

56. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

57. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #10 Feedback

58. What aspects of this description are accurate?

59. What aspects of this description are NOT accurate?

60. How could this description be improved?

Screenshot Description #11

${desc11}

Rate Screenshot Description #11

61. This description accuractley describes the functionality of the screenshot.

Strongly Disagree
Disagree
Neutral
Agree
Strongly Agree

62. Considering the content of the descritpion, do you think that the description:

Has no unnessecary information

Has some unnessecary information

Has a lot of unnessecary information

63. Considering the content of the descritpion, do you think that the description:

Is easy to read and understand

Is somewhat readable and understandable

Is hard to read and understand

Screenshot Description #11 Feedback

64. What aspects of this description are accurate?

65. What aspects of this description are NOT accurate?

66. How could this description be improved?