Welcome to my planned approach to assessing and evaluating my research project outcomes and findings. Here, you will find the methodologies, tools, and techniques I will deploy for the project.
UDEMY IS AN ONLINE LEARNING PLATFORM.
An Educational Tool (Udemy) to Monitor and Improve AI Literacy
UDEMY IS AN ONLINE LEARNING PLATFORM.
This blog outlines the planned approach to assess and evaluate the outcomes and findings of the research project. Why should we consider the need for AI literacy?. Understanding AI is more crucial than ever as society faces a shift in advanced technologies. AI technologies are widely used across many sectors, particularly within the education system, mainly because of their benefits and potential for personalised learning experiences. This project aims to use an exciting online learning platform, Udemy, to monitor and improve AI literacy. There are many online educational platforms offering courses in AI literacy and its applications, such as Coursera, Udemy, and edX. It’s evident that many people still struggle with both theoretical and practical AI applications and there is still a gap in AI literacy, which necessitates deeper research. Many of these learning platforms' content can be monitored through their backend view, making them relevant for evaluating AI literacy. The rationale behind selecting Udemy for assessing the outcomes is that it is a flexible platform which enables instructors to create courses on specific topics of their choice. Ultimately, leveraging the Udemy platform through specific metrics, methodologies, and tools is crucial for monitoring and improving AI literacy. The Udemy datasets will form a part of the project's design, and used to evaluate project outcomes.
Evaluation Metrics
This blog highlights the metrics approach to evaluating the project outcomes. Dashboard analytics, certificate issuance systems, and usability surveys will be employed to monitor and improve AI literacy. These datasets are critical in determining the overall impact.
Dashboards are generally helpful in tracking users' activities, such as engagement and progress. Knowing a user's course completion and engagement time will form part of the assessment design, as this information can be pulled from the Udemy dashboard display. Access to the Udemy backend dashboard called the "Admin Overview" will contribute to the overall AI literacy measurement. The dashboard datasets will help with efficiency upon assessments and act as a centralised information point. Hence, the Udemy backend dashboard is one proposed tool for understanding how users interact with AI content. Moreover, it will allow real-time insight into learner engagement and serve as a monitoring method to improve AI literacy.
The Udemy platform has an automated certificate issuance system to manage certificate issuance, expiration, and renewals. This certification process is integrated into the Udemy dashboard and can be accessed by the Admin. It will be used to assess the learner's progression and rewards. From the certification the admin user can assess the overall grade, achievements and areas of improvement.
The Learner Check-in feature in Udemy is a practical feature for assessing the project outcomes. This research project aims to use User feedback, vital for monitoring and improving AI literacy. By leveraging the usability surveys from the Udemy dashboard alongside the Google Form, one can gain valuable insights into the user's overall learning experience. The combination of both user's engagement and discussion will offer a great assessment design.
Methodology
The project plans to employ a mixed-method approach for evaluation. Quantitative methods, comprising 70% of the evaluation, include dashboard data to track module completion and engagement rates (35%) and measure the percentage of learners completing modules (35%). Qualitative methods, making up the remaining 30%, focus on user feedback gathered from surveys and usability studies to understand learner satisfaction and identify areas for improvement. The methodology will be evaluated on an ongoing basis at different learning stages. This will enable the extraction of data-driven insights, and its statistical analysis will provide feedback for a deeper understanding. Also, real-time progress tracking through an analytics tool in Udemy will monitor user engagement and success rates.
Tools and Techniques
To evaluate AI literacy effectively, the project research considers the applicable techniques and tools that would provide valuable insights into AI literacy. One primary tool is the online learning platform Udemy, which will deliver structured AI educational content. The Udemy backend learning dashboard will track learner engagement, progress, and completion rates. As part of the proposed techniques, Google Forms and Udemy feedback forms will collect post-module feedback and ratings from learners. The real-time feedback will provide insights for monitoring content and improving its delivery. The user usability is proposed to monitor and evaluate the platform through feedback mechanisms. The statistical analysis will compare the pre- post-assessment results. Analytics dashboards like Google Analytics from the feedback forms will monitor engagement.
Predicted Results
Based on the evaluation plan, the expected outcomes include a 90% module completion rate, proposed to be tracked via dashboard analytics, reflecting high learner engagement with the content; a 95% positive rating from post-module surveys, indicating intense learner satisfaction with the course material and delivery; and a projected 30% increase in understanding of AI concepts, measured through pre- and post-assessment scores, will demonstrating significant learning gains.
In closing, the combination of the methodology, tools and techniques presented supports and ensures a comprehensive evaluation of the research project's success. The evidence supports that AI literacy can improve using online platforms like Udemy by addressing user usability and using dashboard analysis and feedback to assess AI literacy. The approach used in this research project fosters and informs learners for the future.
