This report summarizes the feedback from nine students interviewed by Forum Research to get their opinions and recommendations after using a digital fluency assessment chatbot developed by Contact North | Contact Nord. The chatbot is embedded in a mobile app.
The interviews covered all aspects of the app and the chatbot, including:
- Navigation
- Clarity of questions
- Accuracy of scores
- Helpfulness of the responses
- Likelihood of future usage
- Overall experience
- Coverage of topics
- Language inclusivity
- Accessibility
Key findings
1. Ease of Navigation
All participants found the app easy to navigate, with clear instructions and logical progression between questions. The user-friendly experience was attributed to bullet points and straightforward design.
2. Clarity of Self-Assessment Questions
Participants praised the self-assessment questions for being clear and easy to understand. They could provide accurate assessments, but some participants suggested including more specific questions and additional digital fluency areas.
3. Accuracy of Digital Fluency Scores
Participants believed their scores accurately reflected their proficiency level. They felt confident in the assessments, but some desired more in-depth questions for a comprehensive evaluation.
4. Helpful Responses from the Chatbot
The chatbot's responses were generally considered helpful in improving digital fluency skills. Participants appreciated clarifications and suggestions for further research, but desired more detailed instructions with indentation and bullet points.
5. Likelihood of Future App Usage
Most participants expressed willingness to use the app again to assess and improve their digital fluency skills. They valued it as a reference tool, but a few indicated they might not use it due to perceived proficiency or lack of interest.
6. Overall Experience
Participants had a positive experience using the app and the chatbot for digital fluency assessment. They found it user-friendly, appreciated quick response times, and were satisfied with the answers. However, continuous updates were suggested to ensure relevance.
7. Coverage of Digital Fluency Topics
The app was considered comprehensive by most participants, but some recommended including additional areas such as communication tools, personal information vulnerability, and data mining.
8. Language Inclusivity and Accessibility
Participants found the language used in the app and the chatbot’s responses to be inclusive, accessible, and neutral. The contemporary terminology made it suitable for users with different backgrounds and proficiency levels.
Based on the feedback, seven recommendations are proposed
- Include more specific and detailed questions to provide a comprehensive evaluation of digital fluency.
- Incorporate actionable content, such as indentation and bullet points, to make instructions and information more usable.
- Ensure continuous updates to keep the app relevant and up-to-date with the latest technologies and trends.
- Include the suggested areas such as communication tools, personal information vulnerability, and data mining.
- Provide real-time assessments that observe users navigating the digital landscape and perform interactive simulations.
- Improve response times to enhance user experience and engagement.
- Conduct user testing with individuals less familiar with digital fluency concepts to ensure accessibility for all users
Conclusion
- The students' feedback highlights the strengths and weaknesses of Contact North | Contact Nord’s digital fluency assessment chatbot.
- The app received praise for its navigation, clarity of questions, and helpful chatbot responses.
- However, there is room for improvement, including more specific questions and broader coverage of digital fluency topics.
- By implementing these recommendations, the app can provide a more comprehensive and engaging digital fluency assessment experience for users.
