Open Education Analytics (OEA) is a community of education systems and tech partners, coordinated by Microsoft Education, collaborating to develop open source data analytics solutions for the education sector built on Azure Synapse Analytics and PowerBI.
- OEA GitHub Repository: https://github.com/microsoft/OpenEduAnalytics
- OEA Website: https://openeducationanalytics.org
- OEA YouTube Chanel: aka.ms/OEAyoutube
- 5-min OEA Intro Video: Using Data Analytics and AI to transform Education
OEA Working Groups’ Progress
Over 50 OEA members have joined the 4 OEA Working Groups announced in September. Each collaboration is underway with progress to be discussed in the OEA meetings in the coming weeks. By way of summary:
360 Learner Progress: this working group developed a shared conceptual framework of 3 types of analytical models that would help personalize the learner experience: student success models that look across all elements of student engagement; academic success models that look at student progress across all academic courses; and future success models that look at skill development towards specific types of careers or job roles. A few members of the working group are implementing the OEA Framework and will collaborate to build key modules, a shared data model, and ultimately an OEA Package for 360 Learner Progress in 2023.
Learning Analytics: this working group is focused on analytics to support faculty and teachers in understanding their class dynamics. The collaboration is off to a fantastic start. Through discussions, the group has defined the overall goal: to help educators understand if students are actually engaged and learning in classes. Learning Analytics represents the right technology and the right data sources to empower educators to: 1) Support student well-being, freeing students to engage and learn; 2) Find better ways to encourage students to participate, meeting them where they are, and bridge generational gaps between educators and learners; 3) Develop a healthy and engaging learning environment and optimize learning resources to design the best paths towards students’ learning outcomes.
Education System Reporting: In this working group kick-off meeting, the Helsinki Division of Education shared their analytics on modeling student well-being and Fresno Unified School District shared their work on reporting on digital equity. A big thank you to them for sharing excellent examples of data and AI use cases! The group discussed the need to leverage data from other government agencies, such as social services, to get a more layered picture of learning patterns in their systems. Also discussed were how open-source collaborations like OEA can accelerate through using common datasets (like IPEDS in the US) and through using data standards such as Ed-Fi, CEDS, and SIF. OEA has already developed some of these elements that support education reporting through OEA Modules on IPEDS , Ed-FI (to be released soon), and SIF. These will form the foundation of an Education Reporting Package that this group will develop in 2023.
Skills-Based Course Design: This working group has completed a research project to understand the process and needs of course design or syllabus development. There is strong agreement that simplifying the course development process and enabling metadata about instructional design and learning resources to be used for analytics is urgently needed. Also, this project will help course designers map course learning outcomes to the LinkedIn Skills taxonomy so that students can better describe the skills they are developing in the same language that job recruiters use. There is work already underway to build a proof-of-concept app using PowerApps to test out concepts and workflows with a small group of universities.
Please fill out OEA Community - Working Groups Survey if you are interested to participate in the working groups.
Exciting news! Version 0.7 of the OEA framework is now available for setup in production and test environments. This new version makes it faster and easier to set up an Azure Synapse environment for data and AI.
This release includes major changes to the data lake structure as well as the OEA API:
- completely revised data lake structure including a revised folder structure that aligns with the latest recommendations from Cloud-scale analytics
- introduction of “land,” “ingest,” and “refine” methods in OEA to simplify the process of working with new data sources to align with the reference architecture
- easily switch data lake contexts through use of oea.set_workspace, allowing for development to occur in lakehouse “sandboxes”
- extended use of OEA metadata format
- ability to convert swagger into OEA metadata
- updated provisioning of Spark cluster to use Spark v3.2 (instead of 3.1).This also updates Delta Lake to v1.2 (from 1.0)
Version 0.7 of the framework is a significant milestone in the maturation of the OEA framework development and release cycle. This release also makes it possible to adopt a more rigorous release cycle and dependency management for OEA components (i.e., modules, packages, and schemas). This version is one step further on the path towards framework maturity to get to a v1.0 release. Stay tuned for coming information on features and expected release date for v0.8.
In early November the Ed-Fi Alliance hosted the Ed-Fi Summit 2022 in Austin, Texas. This annual conference connects US state and local education leaders in K12, ed-tech providers, educators, and technical experts who are using data to solve education’s most entrenched problems. At the Summit, Gene Garcia (OEA Principal Architect, Microsoft) presented a session titled “Data Validation that Scales” in which he walked through the lakehouse architecture centered on OEA and how this approach is utilized by EdGraph to provide critical data validation at multiple levels. The 100+ attendees of the session demonstrated their interest by staying for the Q&A session immediately following the session – making it clear that data validation remains a significant challenge and key scenario to be addressed through the use of a lakehouse architecture. The recorded audio of the session and the slide deck from the session are available here: Data Validation that Scales . An update to the Ed-Fi OEA module will be released in the coming days.
Data Analytics & AI
To comply with Microsoft’s Responsible AI Principles , all OEA packages that involve machine learning models are going through the Responsible AI Impact Assessment Review with the Microsoft Office of Responsible AI. Last month, the OEA Predicting Chronic Absenteeism package was reviewed and has been approved. We presented the package use case and our approach to model building, addressed how Microsoft’s Responsible AI principles were operationalized, and answered questions by the panel. Considering how critical Responsible AI is to our work, the OEA team is planning a series of trainings for OEA communities to share Responsible AI best practices that should be applied to data and AI projects. We have also started work on integrating Microsoft’s Responsible AI toolkit into OEA packages.
OEA Community Spotlight
In October, the OEA Australia Community hosted a deep dive session on Designing Effective Power BI Reports with more than 100 community members joining, the highest record in an OEA Community meeting so far!
Chris Hamill from the Power BI Team shared the process of designing and delivering compelling, engaging, and intuitive Power BI reports that are easy to understand. The process comprises phases to understand the report users and their requirements, explore report designs, and develop production ready reports.
Chris also shared several examples of Power BI designs while highlighting good and bad practices in each. If interested, take the interactive Microsoft Learn learning path on designing effective Power BI reports here.
For any Power BI question:
- Post your question in general tab in https://aka.ms/pbicat
- Contact your local expert (PBI 50) who knows how to engage the PBI product group
For any Synapse question, you can post a question on this Team site or make a request to the Azure CSE team by submitting a nomination here.