2024-11-14T18:29:47-08:00 2023-12-31 204994635 Iryna AC 1000 Broadway Ste 200-C Oakland CA 94607 990 2023-01-01 842365060 The Learning Agency Lab LEAR 2027135854 2307 S Rural Road Tempe AZ 85282 Ulrich Boser CEO 2024-11-14 true true Kostyantyn Oreshkov EA P00923916 5104679506 2023 2024-10-15 13:58:12Z Ulrich Boser 2307 S Rural Road Tempe AZ 85282 1150141 false X www.the-learning-agency-lab.com X 2019 AZ The Learning Agency Lab is focused on developing science of learning-based tools and programs for the social good. We help educators, researchers and others to understand the science of learning and how students can learn how to learn better. 4 3 7 3 0 1592328 1110949 8682 19266 19926 606 0 1601616 1150141 0 0 456800 343505 0 0 819816 942987 1276616 1286492 325000 -136351 2225913 2814970 482611 1208019 1743302 1606951 The learning agency lab seeks to improve the effectiveness of k-16 education, especially for historically marginalized populations, by creating free or at-cost resources that are aligned to the science of learning. false false 1128801 19266 In the 2023 fiscal year, The Learning Agency Lab continued to build momentum in advancing educational technology through data science competitions and community engagement. By September, the Lab successfully launched three major competitions in the Open Data Assessment Fund (ODAF) series, which focused on improving educational outcomes through cutting-edge algorithm development.The first competition, The Quest for Quality Questions: Improving Reading Comprehension through Automated Question Generation, concluded in March 2023. This competition attracted 10 teams, with over 40 participants from around the world. The challenge addressed a critical issue in assessing student reading comprehension by developing models that automatically generate comprehension questions. These models, trained on a dataset of childrens storybooks, demonstrated the ability to produce human-like fluency in question generation, which presents a significant advancement in AI-supported education. By helping educators save time, these tools have the potential to broaden the range of texts students can engage with.In June 2023, the second competition, Predict Student Performance from Game Play, concluded with over 2,000 participants submitting 54,000 entries. Using data from the educational game Jo Wilder and the Capitol Case, this competition focused on advancing knowledge tracing to predict how students learn and perform in educational games. The top-scoring model provided accurate predictions of student success, surpassing human capabilities and paving the way for improved educational game development, targeted interventions, and real-time feedback for educators.The third competition, CommonLit - Evaluate Student Summaries, completed in October 2023. With 2,450 participants and nearly 45,000 entries, it focused on creating models that automatically assess student-written summaries for grades 3-12. The models, developed for both traditional accuracy and computational efficiency, make them suitable for low-resource environments. These models enable teachers to efficiently evaluate students summarization skills, encouraging more frequent use of this important instructional strategy by reducing grading burdens.The Lab also strengthened its engagement with stakeholders by establishing a Teacher Advisory Board, which provided critical feedback for refining competition ideas. The Board consisted of five teachers from a range of grades between K-12 and teach a variety of subjects. Several of the teachers work with low-income students or English Language Learners as well. Their interests, feedback, and ideas drove discussion and goals for many of the data science competitions this year and helped set the stage for next year. For instance, the overwhelming support for an AI detection tool led to a 2024 AI Writing Detection competition. The Lab has also forged strong relationships with vendors to maximize the real-world impact of its work. For example, the algorithms from the Jo Wilder competition were shared with one of the top educational gaming platforms in the U.S., demonstrating the Labs growing influence on the broader educational technology landscape. The Lab hopes to see the algorithm integrated into their future games to provide further insights during gameplay.In alignment with its mission to promote innovation and make data more accessible, the Lab launched the Learning Exchange platform in 2023. This platform hosts datasets and winning algorithms from completed competitions, making them available for public use and encouraging further research and development. Researchers have already begun utilizing the Exchange, with one standout example being a winning team from The Quest for Quality Questions competition whose paper was recognized at the 2023 BAE conference.Beyond its competitions, the Lab continues to foster the learning engineering community through its Learning Engineering Ambassador and Internship programs. The Ambassador Program ran a spring cohort, with one ambassador continuing in the fall. The program engaged students with a diverse range of educational interests, from K-12 learning to adult education. The ambassadors each hosted multiple events, demonstrating the broad scope and relevance of learning engineering. Additionally, the third cohort of the Learning Engineering Internship Program launched in spring 2023, providing undergraduate, graduate, and PhD students the opportunity to work with university labs and education-focused organizations. The interns contributed to a wide range of projects, from research to data visualization and coding, further advancing the Labs mission of empowering the next generation of learning engineers.Overall, the Labs efforts in 2023 significantly advanced AI and data science in education. These competitions and initiatives have produced valuable tools for educators and students alike, while also fostering a growing global community of learning engineers. With plans for future competitions and partnerships, the Lab is positioned for even greater impact in the coming year. 1128801 true true false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false false true 21 0 true 7 true false false false false false false false 0 false false false false false false false X 4 3 false false false false false false false true true false false true true true true false false true true false X Ulrich Boser 2027135854 2307 S Rural Road Tempe AZ 85282 Perpetual Baffour Data Scientist 40.00 0.00 105553 0 11334 Ulrich Boser CEO 20.00 0.00 X X 84992 0 14179 Kenneth Stern President 1.00 0.00 X X 0 0 0 David Domenici Treasurer 1.00 0.00 X X 0 0 0 Gabriela Lopez Director 1.00 0.00 X 0 0 0 190545 25513 1 false false false Kaggle Inc 1600 Amphitheatre Parkway Mountain View CA 94043 Contract Services 225000 Google LLC 1600 Amphitheatre Parkway Mountain View CA 94043 hosting services 129720 Measurement Incorporated 423 Morris Street Durham NC 27701 Scoring Services 123376 3 1110949 1110949 Online Courses 611710 3 3 Program Service Contracts 611710 19263 19263 19266 19926 19926 0 0 0 0 0 0 0 0 1150141 19266 19926 X 0 0 0 0 99171 89254 9917 0 196504 165028 31476 10319 8796 1523 14208 9802 4406 23303 20214 3089 0 1842 878 964 24000 24000 0 0 0 861098 789847 71251 435 435 1143 930 213 9251 6697 2554 0 0 5007 4815 192 0 350 350 0 0 0 8222 538 7684 Dues and other charges 31201 31017 184 Miscellaneous Expense 438 200 238 0 1286492 1128801 157691 0 2165177 1101663 819926 60081 892336 0 0 0 0 0 655 1045 0 0 0 0 0 0 2225913 2814970 87101 66200 395510 1141819 482611 1208019 X 441075 587581 1302227 1019370 1743302 1606951 2225913 2814970 -136351 X false false false X 100000 784207 2251613 1592328 1110949 5839097 0 0 100000 784207 2251613 1592328 1110949 5839097 0 5839097 19926 19926 0 288 213 606 1107 5860130 154425 X 0.00000 RESTRICTED RESTRICTED RESTRICTED RESTRICTED RESTRICTED RESTRICTED RESTRICTED RESTRICTED Form 990, Part VI, Section B, Line 11b In order to review the Form 990, the Executive Director, Finance and Operations Director, Finance and Operations Manager, and the external bookkeeping consultant all do an initial review of the draft Form 990. After the initial review of Form 990 from the internal staff, then it is distributed to all board members for review prior to filing. Form 990, Part VI, Section B, Line 12c Each Director, officer, key employee, and member of a committee or subcommittee of the Board with Board-delegated powers shall annually complete and sign the form of the Corporations Annual Conflict of Interest Acknowledgment Statement as may be amended by the Board from time to time. Form 990, Part VI, Section B, Line 15a The organization utilized an analysis of similar/like organizations in Guidestar, the largest source of salary information on U.S. nonprofit organizations containing information on every public charity, private foundation, and other 501c3 organizations to which contributions may be tax deductible. The analysis included data on salary minimum/mid/max ranges of similar/like organizations to The Learning Agency Lab. The Learning Agency Lab used this data to create salary bands and considered tenure, number of applicable years of experience and position within the organization to determine equitable pay. Form 990, Part VI, Section C, Line 19 Upon request.