Learning Assessment Specialist / Data Scientist

Send your cover letter and CV to: 
Erin Knight, Badges and Assessment Lead // erin.knight21 at gmail dot com

P2PU is looking to hire an assessment expert, who wants to build meaningful, relevant, and robust assessment systems into our social learning platform. The original focus is on two flagship pilots projects (but results are expected to spread into other areas of P2PU in the longer term):

• The School of Webcraft is a partnership between P2PU and Mozilla to radically transform web developer training, including certification. We need to develop assessments that cover both 21st century skills, as well as hard technical skills. 
• Through a partnership with UC Irvine, P2PU is exploring pathways from social learning online into certification by an accredited institution, starting in the area of professional education. We need to develop assessments that feed into the certification process at UCI.

Profile

• Education hacker - passionate about fixing education, open to rethinking of key assumptions and approaches
• Experience in and solid understanding of assessment practices, research and literature
• Strong Understands how game mechanics, data science, and learning analytics are driving the assessments of the future
• Sufficient web development background to be able to create functional designs and lead implementation of assessments into P2PU platform
• Strong project management skills - able to manage own time and work on multiple parallel projects, in a highly distributed environment
• Ability to travel for conferences, meet-ups and presentations

Responsibilities

• Project and implementation management for all assessment work in P2PU (focus on priority pilots SoW and UCI)
• Design, manage implementation, and track performance of assessments that:
  • Provide evidence of the achievements of users at P2PU
  • Take into account 21st century skills like proble-solving, collaboration, and team work
  • Are robust and valid
  • Are evidence-based and data-driven, and scale
  • Use a combination of:
    • Stealth assessment
    • Peer assessment
    • Guru/expert assessment
• Drive the assessment research work, including through surveys with participants, and by tracking metrics that provide insight into performance of assessments
• Work closely with P2PU dev team to manage implementation of the assessments features into the platform
• Collaborate with community/partners/stakeholders to determine which skills and competenies to develop assessment for:
  • Works closely with SoW Product Manager and wider SoW community (including partners) to jointly identify appropriate skills and competencies for which to provide assessments, and support communication to participants.
  • Work closely with UCI staff to identify appropriate assessments to enable Professional Education certification
• Contribute to course facilitator orientation and training where necessary
• Track participation and use, weekly report outs
• Work in the open - share early and often, through community channels - blogs, twitter, conferences, mailing lists, etc. 
• Bonus: help drafting publications/articles

Logistics

• Reports to: Executive Director, P2PU. In addition, this role reports on all day-to-day operations, and strategic decisions for assessment related work, to Badges and Assessment Project Lead [does this second part deal with your concern?]
• P2PU Contract for 12 month (planned extension to 2 years)
• Location: open, can work remotely from anywhere
• Language: English