July 25
Progress
Project Plans (Vanessa's are complete)
Badges
- 60 new Badges up during July: http://badges.p2pu.org/en/browse
- Copy fixed and merged--waiting for the next deploy
- P2PU logo use (to put on discourse)
- trusted member of the community
- member for a while
- course is in line with our philosophy
- vanessa was involved in designing the course
Making noise: Blog post from last week on the Bronx (made some noise): http://info.p2pu.org/2013/07/19/badges-in-the-bronx-p2pu-youth-voices/
School of Webcraft plan
Priorities:
Assessment Framework revisions
Questions:
- P2PU examples--can you say more about the framing? How should these be examples if not luminary ones?
- "If this document is your inspiration for assessing learning at P2PU, what are some examples of you doing that - and what are some ideas that we aren’t implementing yet?"
- Small steps
- Wikipedia course is an example of assessment happening in other open communities--assessment that's already occuring
- I am worried that we are ignoring a lot of terminology and research on learning. For example the reflection section talks about self-assessment. There is a huge literacy about meta learning.
- Where else is it weak? Meta learning and....
- Fluffy--do you mean scale back the inspirational? I am trying not to bore myself....
Data MOOC Agenda
Take a tour feature
Thinking about your traveling metaphor for "take a tour" https://plus.google.com/communities/111619469354411254407/stream/693751c9-77e7-4e53-bb81-7392fa71f67c
Review
Goals
School of Webcraft plan
revise based on feedback (for Friday)
phases or altneratives
option 0: spin it out and rebrand it--but it can live somewhere
option 1: small $5,000 (we host it for you)
option 2: big $50,000 (group the informal tech education option)
Process
Agenda for MOOC meeting?
July 16
Progress:
Project Plans:
Badges release:
Badge goals:
Feedback on Badges: http://thepeople.p2pu.org/t/feedback-on-badges-p2pu-org/113
Priorities
- School of Webcraft: http://pad.p2pu.org/p/SoW_Brainstorm (Laura, Doug, Chloe)
- VMG: write a 2 paragraph proposal on audience and scope
- Share with our team
- VMG shares with Doug and Laura, P shares with MS
- Lunch and Learn at Creative Commons 7/23
- Project plan for assessment document
- Send Assessment treatise to relevant folks
- Alex Halavais, Erin Knight, Chloe Varelidi
- Relationship with Open Tech School
- Interested in building out partner badges with P2PU
- 30-40 badges
- MOOC Research Fllowup (we hear the 20th)
- New Research Candidate Katie DeVries Hassman PhD at Syracuse
- Full day of Wednesday 24th revise comments on assessment treatise
- Blog post on day at Youth Voices: http://youthvoices.net/badgessummer2013?no_redirect=true
- Copy and paste 1 para from 3 proposals onto discourse
- Move project plans to discourse under "org"
- Change badge creation copy "Because folks with this Badge can"
- About page: At P2PU
, we believe learning is guided by people, passion, and projects. [DONE]
Parkling Lot
Versioning of Badges
Follow Up from intense vmg ps convo
July 2
Progress:
- Copy and design for Badge integration
- Reviewed 2/4 School of Open courses for Badges
- Research proposals--reviewed proposal, drafted MoU
- Spent more time reviewing courses and meeting with P2PU team
- Revised first 3 pages of Assessment Treatise based on P's feedback
Priorities
- Assessment Treatise--to be done when P comes back (and getting pretty into it)
- Badges release Friday
- Revise "About" page copy
- Revise "Badgemaker" course
- Blog post about integrations from a "How To" persepctive
- Alert potential partners: School of Open, OCW, School of Ed
- Big Badges initiative--30 Badges during the month of July
- Tighten up MMOOC copy, take over Social Media responsibilities for Steve next week
- MOOC Research
- Forward the proposal to natalie
- Work with 2 other researchers on proporsals (Thieme and Cory Brozina from Viriginia tech)
- Work with Anna on Project Plan for Data Explorer Mission
- Tentative dates--start building the timeline, details--use the time in Boston to meet and refine, then launch it after Boston
- The goal has to be be that the next one works in a big way
- Group identity tools
- OKFN faciliators--request an expert
- Don't rush it
- School of Webcraft proposal
- 200 and 300 level courses using new Mozilla tools
- Put courses in the new UX (not sure about this - challenges UX works really well for this)---is there a way to make the disussion better?
- Integrate with new Badges
- Meeting with Doug Belshaw on July 17
- Should it stand alone? Should we build a strong developer community? Be involved in the next iteration, put pass it over to Mozilla team--spin it out onto its own server but we chrge them for it
- Finish reviewing School of Open courses
- Create Project plans for Badges, Assessment document
- Still need to revise theory of learning in light of P and community feedback
- Start a larger conversation
- Appeal to community for buy in and revision
From P:
Blog post could be "here is something new you can do with badges and courses at P2PU" - high level, focus on why (rather than how).
Then create how-to documents on help.p2pu.org (or somewhere else) for the two use-cases, and point people to those from the blog post.
Philipp Schmidt
Jul-1 5:29 PM
And send two separate emails with links to the how-tos to the audiences for whom it is most relevant (users who have a badge for showing off your badges elsewhere / course organizers, for adding a badge to your course)
Those are my quick thoughts. I might be missing a piece. Or you might decide it doesn't make sense once you start writing the copy. So take it as input, nothing more.
Process
Problems
June 25:
Progress:
- Revamped theory of learning: http://info.p2pu.org/about/how-we-learn/
- VMG: share on discourse and does it reasonate with people / what's missing? / is this the right framing
- Visually---image on top isn't grabbing philipp
- Missing: passion / curiosity / interest piece
- Tighten it up a bit and put it on discourse
- For further reading & academic links--evidence behind the things that we are doing - will make a stronger case
- Assessment principles: https://docs.google.com/document/d/1YmLjyZgxYq3C1P_Fx6F3TeQTNInddgMjjxWYqNCM0cM/edit#
- consistency: people, passion and projects
- Draft research email for Mechanical MOOC that visualizes data
Priorities:
- Copy for Badge Integration
- Work with Jane on School of Open Badges (meeting after this one to discuss the plan)
- MOOC Research proposal
- 10-25k $
- Deadline July 7
- Supposed to connect with June soon
- Abelardo Pardo from University of Sydney
- Music MOOC
- Schedule and project plan for Data Explorer Mission (can we kick until August, please)
- Update "About Badges" with screenshots of our snappy new style
- Add case studies to assessment
- Share with friendly researchers / experts
- Karen Brennan, Alex Halavais, Karen Fasimpaur, Ahrash Bissell, Philipp
- Ask: We think there is an opportunity to reframe the conversation about assessment.
- Do the principles "feel right"? What's missing?
- We're targeting folks in the assessment "world" and trying to get them to think differently. Are the ideas successful in that light / for that audience? (we don't just want to preach to the choir) (and we're not very good at preaching)
- Where do we need more evidence to support our ideas?
Process
- Cheques for Vanessa? -> Shredded
- Vanessa has been tracking her hours for the past week. She spends most of her time writing things: blog posts, papers, course materials, copy (though she is tracking by project)
- Meeting with project partners Jane, Lucy, Anna
- Projects lists
- Vanessa is on vacation August 15-20 (and offline)
Problems
- Partnership things?
- Save Vanessa from herself!
Text for mining:
At the MIT Media Lab, we are developing new technologies and strategies for cultivating creative thinking and learning. Our approach is based on four guiding principles:
- Learning through Making. People learn best when they are actively engaged in designing, creating, and making things. Creating is at the root of creative learning.
- Peer 2 Peer Learning. Learning is a social activity, in which people share ideas and build upon one another’s work, in the same spirit as open-source software development.
- Passionate Learning. When people work on projects they care about, they work longer and harder, persist in the face of challenges, and learn more in the process.
- Playful Learning. Learning involves playful experimentation – trying new things, tinkering with materials, testing boundaries, taking risks, iterating again and again. (NO SENSE OF FAILURE!)
We apply these principles to our own work within the Media Lab, sparking creativity and innovation in our research. And we share our creative-learning ideas and technologies outside of the Lab, to help others engage in Media Lab-style learning.
June 18
Group presence feature development (timeline? VMG to drive)
When we talk about assessment we always are thinking about what's important about learning
Can't really decouple assessment from what the purpose of learning is
There are various frameworks about learning
We have a bias towards social and peer to peer learning-->outcome of which is feeling a sense of community
- 6th principle: learners feel that they deserve to be there
We provide concrete applications with case studies
Assessment framework
- Saw you made good edits!
- Assessment Principle 1: Navigate the Community of Practice
- Definition of what is "quality" work
- levels of quality
- definition of quality work
- Onboarding to peer learning: understand learners are in control of their own learning, must kickstart themselves
- Assessment Principle 2: Feedback is a Core Skill (merge with Assessment Principle 4: Everyone’s a Critic?)
- Critical part of being in a community is knowing that you have a voice and an occasion to use it
- Feedback as an occasion to enter the community
- No line between person assessing and being assessed--power of a networked community
- Assessment Principle 3: Aim for Iteration
- Assessment moves ideas and projects forward
- Failure isn't part of the process-->life is a prototype, assessment helps you improve it
- No need to "get it right" the first time - assessment supports tinkering, playing, experim
- Things are in flux, assessment should be improving (more a community/meta statement)
- Assessment Principle 4: Experts have empathy
- (We don't like the term, because it implies hierarchies / questions legitimacy)
- Choice in appealing to expertise--apprentice and master is a choice
- Experts guide and support, don't judge and condem
- How important are experts? As a rung of support. A cushion. Also to point in a new direction. Show possibility.
- Empathize with where learners are at
- Assessment Principle 5: Do the Reflection Dance.
- Self-assessment in place
- Defining goals
- Schön (1987) describes this mode of working as “reflective practice” and provides examples in diverse domains (architecture, psychotherapy, concert violin)
- Assessment Principle 6: In the beginners mind there are many possibilities
- http://en.wikipedia.org/wiki/Shoshin
- Multiple pathways through the project: “provides the flexibility of allowing for multiple paths through the knowledge domain, and supports those learning at different levels of expertise, at different speeds, and within a variety of contexts.” (Gibson)
- Prerequisites are "not a good idea"
- Focus on big/interesting problems - and embrace all solutions
Navigating the Community of Practice
- Community assessment together
- Reflect as community: post-mortems and open recaps
End:
- Parking Lot
- Projects vs Questions?
- Assessment of things that are binary right/wrong vs projects
- What is the value in having qualitative feedback?
- Don't mix assessment with credentialing
- Are these models of assessment? Or mechanisms
- Model -> behavior, practices
- Check -> behavior, practices
Community of practice has ways of defining quality
Assessment is the negotiation of those things
As you are becoming a member of community of practice you are bumping up against those things
Always in flux-->against the idea that the things that matter are fixed and static
Progress
Priorities
- Finish scoda blog post - Check!
- Developing Musical MOOC activities and tools (can we make this more concrete? what is the actual next step here?)
- Copy for Badge Integration
- Work with Jane on School of Open Badges
- Schedule and project plan for Data Explorer Mission (can we kick until August, please)
- 2-3 more examples from assessment paper
- Update "Theory of Learning"
- Update "About Badges" with screenshots of our snappy new style
Process / Ideas on the Horizon
Read your post: http://sharing-nicely.net/2013/06/how-to-build-a-project / Why not on P2PU????
- Not sure. Seemed more fitting as a personal view on projects in general, not specific to P2PU. I'm still negotiating what should go where. Not sure I get it right all the time.
June 11
Progress:
- Data POOC:
- Assessment as "thanks"--but possibly not Badges but with Q&A
- 3 day peer learning coaches training in London
- Summary:
- The POOC is a Personalized, Open, Online Course that is a partnership between the Open Knowledge Foundation and Peer 2 Peer University.
- The course will begin by a 1:1 virtual meeting between a Coach and a learner. These meetings will happen over 2-3 weeks. Then a learner will be put in a group based on their interest, and work together over the course of 3 days.
- The Coach training will take place in London the first week of September. Coaches will begin to have interviews in the 2 weeks after.
- Course will open for signup around Sept 1, begin formally Sept 15, wrap up by Sep 20.
- Step 0: Data Onboarding
- Step 1: Data Mentorship:
- 1-on-1 hangout with Coach
- Introduction to tools and topics
- Learner selects topic
- Step 2: Placed in group based on area of interest
- Step 3: ...
- P's feedback
- What about people who want to participate in coaches meetups but can't make it to the location
- # of p2pu tools?
- How can we work on training/bringing together facilitators virtually?
- Ask people to sign up as facilitators...
- Do people want to be involved as facilitators over and over again.
- Did we recognize contributions enough? Motivate them enough?
- 1:1 meetings seems difficult to schedule and scale
- Badges as thanks--what are you trying to do as a facilitator...
- Learners might give you really good grades if you answer their questions...
- What's need is thinking about training/recognizing facilitation--which is a direct outcome of the researc
- Music MOOC--"Introduction to Musical Expression"
- http://pad.p2pu.org/p/music_moo
- Need to figure out learning goals, then choose the tools
- So far, we're thinking:
- meaningfully express yourself in music
- make a project each week that we can share
- musical collaboration / music as communication
- Activities
- match a pitch
- keeping time with your body, playing along
- writing lyrics
- singing in the shower
- remixing by adding a track
- Research Community
- MOOC Research initative:
- "Hi Vanessa - just to clarify - are you stating that you don't have particular research goals/requests in mind, but that if someone has research goals and needs data, you'd be willing to partner with them?"
- Ideas:
- Learner trajectories/how does P2PU change lives? -> Academic mindsets
- Networked relationships--how do relationships evolve on P2PU and help people longer-term
- Group formation (peer learning in small groups, vs large online communities)
- Spotify playlist for translators--Dirk pulled the list for me, I'll send a note
Problems
- Badgery with Data
- Badge widget--haven't gotten to it yet
Process
- Vanessa is doing. A lot. There are. A lot. of Projects.
May 28
Progress:
- Research and Data Blog post: http://info.p2pu.org/2013/05/27/step-into-our-lab-what-have-our-researchers-found/
- Confab slides are revised and awesome--and all because of you!
- Hewlett white paper -> Community call (I had a presentation prepared--boo)
- Specifically, a feeling of belonging and progress of deeper learning
- Next iteration, do weekly blog posts on what groups were up to and their weekly analytics?
- Met on Mailgun analytics
- Wireframes for integration posted
Priorities:
- Can we make assesssment pieces my one priority until Friday?
- Others are Music MOOC, Data data, what to do next with School of Data, revise create a course course, revise wireframes
Parking Lot
- School of Data next steps (Staggered MOOC?)
- Some groups need more time (let them request the next week, rather than automate)
- Could also consider running as a Sprint
- Research on MOOCs (both questions we want to ask, and process/tools)
- Phase III badges Our plans for badges.p2pu.org (feature development, but also what we can learn from it)
- Assessment document
- Music MOOC
- Vanessa wants to run a non profit
May 21
Progress
- Confab Slides (see notes below)
- Phase III for badges planning done
- Hewlett proposal
- Defining DL for the individual courses - we kind of have to be further along in course design to be able to do that (PS: Good point. I will add a notes to this respect in the proposal)
- Context for Making course. Very vague. Might need to add more detail. Frame as design thinking through making.
- Data course - draft.
- Applying our approach to the more traditional course is the most experimental / biggest challenge. There is less certainty how well it will work.
- Hewlett white paper
- Mailgun Stats -- Vanessa is getting a trainer to talk to me and Dirk
- The Mailgun stats do not add up or make sense (it's confusing)
Priorities
- Music Sample Mooc
- Mailgun Training (record if possible)
- Hewlett white paper -> Community call
- 2-3 examples of courses/outcomes for Assessment Principles
- Research and Data Blog Post
- We're thinking about our data
- Research is important, this is the time to experiment
- 2-3 papers that are coming out of p2pu
- Put short abstracts (and maybe reflections) on info.p2pu.org and add links (not just links)
- Research Making Hay
- Attract more researchers
- Position P2PU as something that is open--could attract more funders in this way
Problems
- 7 days of low productivity
Process
Parking Lot
- Discourse URL -> community or thepeople
- Slides for Confab
- Strategic start to the email? -> "wildly hungover"
- Point taken. Was meant to make you smile, but backfired. As is the trend.
- Peer learning -> Add "breaking down hierarchy" rather than everyone at the same level (we often hear, "how can that work, the blind leading the blind?")
- Not sure about how you frame "making" as part of peer learning
- --got it.
- Overall timing very ambitious - not much wiggle room (maybe good, but risky)
- Hmmm, let me think about that.
- Instead of just showing team, maybe also show People gallery from info.p2pu.org
- Point I'm trying to make is that even a small organization can make strides with the right strategies--other ideas on how to do that?
- Executive Hustler? I take that as a compliment, but it doesn't work outside the US. Maybe change to something else? Please!
- This talk is in the US :) But what would you like to be called? "Mayor"? "Herder of the Hardheaded"? Both of those are good. Executive Janitor?
- Is the "ask" too big and confusing - it's not 100% clear to me? How about applying it to their own work? Making a change to what they do already, that's based on your recommendations.
- Maybe I could ask this when people present--how did this exercise make you see your work differently?
- Add @p2pu twitter handle to final slide-yessir
- Raises a lot of good questions for P2PU (actually / also for your talk - why are you not showing examples of these strategies from our own work - you may need a sentence or two to frame that)
- Why don't we have the spotlight on great people?
- I've actually raised this several times before, I think, in Content Strategy discussions with Bekka. We should be actively interviewing users, posting success stories to the site.
- The key user generated content at P2PU are (a) courses, (b) contributions in courses - How can we get better at applying these strategies to our own user generated content? I think that kind of project requires reconsidering the onboarding experience--rethinking that flow and copy. I'd happily dig into that.
- Show examples from P2PU--Badges
- Peer learning is how I'm coming to this conversation
- Frame the overall conversation as "Good Practices in UGC"
- P2PU is how I'm coming to this conversation
5/14
Progress
- Hewlett report
- Vision
- School of Data
- Hoping to schedule a meeting in Berlin in early June (PS sent email)
- How is the mission going?
- About 50% of groups still active
- All over the map with progress (some are far ahead of others)
- Some ideas on supporting groups out of regular email schedule
- Talk for confab
- June 2-6 (out of action / offline)
- Let everyone know please (2 weeks ahead)
- assessment principles--found courses and perusing through them
Priorities
- Data Explorer Mission Survey
Misc:
- Neil (School of Data) t-shirts
- Learning research -> Small groups not working - what can we do?
- Also, process & tools -> Mailgun/Email stats, process and results - Compare different Mech MOOCs
- Badges phase II done?
4/30
- Progress:
- Assessment principles
- ~40% "there"
- Idea for Case studies--we could use examples from P2PU courses
- Spend some time digging through courses
- Ideas
- Community learning: Zac's Course
- Projects: Audacity Course
- Is our original claim true? Does peer learning actually match with the expecation that you'll learn deeper learning or 21st century skills?
- Hewlett report
- School of Data
- Report and finance report
- Summit
- VMG send message: thursday the 9th--keep everyone on copy
- Badge improvements
- OBI integration
- CSS improvement
- Need to write a blog post about this release
- Problems
- Badges review with Experts / partner needs
Parking Lot:
- OER Research in the UK (Jane still thinks you are coming - she says she wrote a proposal to Open UK)
- Let's decide if we care about these questions enough to send you.
- Or if we send Jane, but would require stronger focus on SOO.
- I know--I just haven't gotten to it yet. I suck.
- Music MOOC feedback was excellent!
- Lucy (via Bekka) -> "People want to learn something in one evening (is four weeks too long?)"
- Check in with Bekka on feedback from Lucy
- This is good feedback in light of hewlett proposal
- Discuss badges work for School of Data (now and going forward) vis a vis Hewlett grant
4/19/2013
Progress
- Assessment principles
- Suggestion: Dan Schwartz (Stanford) - Measuring what Matters (pdf available online)
- OER Research Proposal: http://pad.p2pu.org/p/oer-research
- Board meeting
- Data Explorer Mission
- Tracking stats
- Answering help / being support (not sustainable for future rounds, or larger courses)
- OKFN Summit Agenda
- What worked / what didnt
- Data Explorer Mission
- Sustainability
- Badges
Priorities
- Assessment principles outline / structure
- Data Explorer Mission next week (here is how it works / community or blog post update?)
- School of Data report
- Find out what (if anything) more is needed, also from Philipp
- Prepare rough finance/budget breakdown for our costs
- Music
- Refocus the course from the perspective of play
- Low floor / barrier to entry & high ceiling
- How will people interact around what they are making?
Process
Problems
- MOOC email scheduler not working
- Success message
- See the message after I send it
4/16/2013
Process: Berlin is making Vanessa insanely productive
- Board meeting
- School of Data
- Launch
- VMG is putting emails in and scheduling them
- Vision meeting
- Dynamics
- Grant report (OSI not Hewlett)
- Mozz's lil research project--do you have feedback on that?
- Rest of the week is assessment
manifesto (pleeeeease not manifesto!), promise promise promise--I'm in a writing mode, specifically about community :) - AND ILL COME UP WITH A BETTER NAME
To do: ask dirk to add me to the course
4/16/2013
School of Data updateBoard slidesBlog postRest of week--focusing on assessment principles
4/12/2013
Progress
- School of Data
- Explorer Mission
- Funding/progress report
- Need to implement badges today
- Issues with publicity--so we're thinking about this in terms of pilot
Priorities
- Audience: not so much people who are in communities of practice, but people who are interested in the conversation about assessment
- Someone who has worked on assessment can read, and there are some ideas in there that can make them think---
- Assessment is broken, here are some details that are more broadly applicable--things that are happening across the field, that people can apply
- Even the term assessment is difficult to write about, because there are so many perceptions about what assessment is, each person brings to it their own lens
- We would like the term "assessment" to be friendlier in a way
- Traditional: The people who are learning and the people who are assessing are two different groups, but in the community this happens in one group, there isn't a separation between the people learning and the people assessing.
- Role of community in the assessment principles--maybe start from here because this is what makes it different entirely, and then drill down to projects
- Length: a very concise first page--take the first lines of each major paragraph, line them up, and make that a very compelling first page. It can even be 10 pages (whoah nelly)
- Conservatory
- Countours
- Wouldn't speak about "P2PUs" community--but communities in general
- Learning cannot be separated from the idea of communities of practice
- What else can we call it? Nerd herds. All communities of practice brand themselves--they have very clearly understood norms and values and habits.
- Learning is the trajectory that takes you from participant to the core of the community
- Learning then has all of these aspects--feedback / projects / iteration /
- We're seeing the same things online and also offline
http://net.educause.edu/ir/library/pdf/ERM0811.pdf
- Outstanding: still need to reach out to those folks from School of Data on action items
- To Do:
- Reach out to School of Data about funds for workshop
- Meet in Berlin May 8th to talk about next steps and workflow and vision for School of Data
- To School of Data people--we're going to be hacking on this--if they have any time to spend on this, it would be great to do a virtual collaboration
- Review the Hewlett grant for School of Data viz badges
Vanessa: send an email to the OKFN and P2PU list
Ask people to retweet and get the word out
Smaller groups--we'll have a better sense of what's going on
Questions for Lucy:
Can we get the course on the OFKN homepage?
It would be nice to be able to feature certain things
Pull blog post into featured post and aggregated onto the homepage
Do you have a format that you want to use for the Hewlett grant?
Hewlett grant--
Add Badges stuff as much as possible
Put in Vanessa's time and Philipp will put in some numbers...
Make it as a slide for the board meeting
Need to send OKFN an invoice--so the work is useful
3 days left to register on that blog post
Nate Mathias--ask him to help get the word out
Board meeting next Friday
4/2/2013
Progress:
- School of Data Explorer Mission
- Hackathon: Google Hangout Script, Grouping Script, Setting Up Mailgun and Scheduling Emails
- Formative Evaluation Webinar (DML badges grantees) - Tuesday 4/9
- Teachers Teaching Teachers Badge Demo (Paul Allison webinar) - Weds 4/3 (with Dirk)
Priorities
- Badges improvements
- Experts--how to handle?
- Testing--nomenclature
- Badges discussion on community call
Problems:
- Towards a New Vision of Assessment
- Bekka's help?
- Difficulty--assessment paper is totally dry, so I struggle with it
- P's feedback--don't feel stuck by the style, engage with the ideas---toughen up on this thing, P needs Mozz to get 'her done
- School of Open
- Clarify P2PU strategy regarding platform & community
- Message the move away from platform / refocusing on experiments / realization the platform is a massive undertaking
- How can we best support our community / role of the platform in that
- Ways to support platform:
- More volunteer contributions
- More funding, incl. from partners
- How does this impact Vanessa's role - Help community build awesome learning experiences across the web
To Do:
Reach out to School of Data about funds for workshop
Meet in Berlin May 8th to talk about next steps and workflow and vision for School of Data
To School of Data people--we're going to be hacking on this--if they have any time to spend on this, it would be great to do a virtual collaboration
Review the Hewlett grant for School of Data viz badges
Community call: Jane, School of Data,
School of Data--
In school of open we have all these courses
recruit 10 people to run courses, we can give you advice with community review
VMG is learning consultant, Lucy schedules and runs project management
3/26/2013
Progress:
- School of Data Explorer Mission
- Badges review: we need experts -> ask Lucy to recruit in the School of Data community
- Badges
- Sync with Erika and Dirk tomorrow on improvements
- Features identified for next sprint:
- Integration with p2pu.org (embed as iFrame)
- OBI integration (pushing badges, metadata?)
- Admin functions
- Featured Badges
- Delete/Archive Badges
- Featured Projects
- Landing page gallery: sort, search and filter
- Badge creation image tool--shapes and colors
- Report useful feedback--buttons for yes and no
- LIve feed of activity--to appear on user Dashboard
- Show badge criteria as user delivers feedback
- Copy--see “Vanessification”
- Badge creation flow: ask user to submit a sample project upon creation of a Badge
- Top Nav Level: See All Badges/Browse All Badges/Discovery mechanism for seeing what Badges exist that you can apply for
- Display of badges on landing page
- Rich Text (HTML5 / Markdown) fields for
- Feedback
- Badge requirements (check if OBI compliant)
Priorities:
- Assessment Principles. Sorry, I suck -- haha ;-)
- Hackathon planning (Expedition project)
- Create a Badge challenge update
Process:
3/19/2013
Progress
Priorities
- School of Data / Data Expedition
- Assessment document
- Badges next steps planning
- Blog post
- Think about attracting more early adopters
- What are the things VMG wants to test/find out more about---how do we know if it's working / what does success look like? + A few sentences about DML
- [ok to push to next week / also waiting for DU] Discourse Pilot planning
- How many people we want to test with it?
- What are the things we want to know?
- Establish the use cases?
- Test:
- Small group (VMG, P, Jane, Bekka, EP, DU, CE, Karen Fasimpaur, Jose)
- Make discourse default for staff communication (need a reason to use email)
Process
- Bekka / Vanessa roles and responsibilities
Problems
3/12/2013
Stuff:
- Open Learning hackathon - design event / workshop set-up / homework
- Google Hangout "scripts" (School of Data, but could also be applied as a general "ask" for new community members -> organize a hangout, here is the script)
- New responsies
- DML demo
- VMG: What are you working on? This is our system/platform--how would you use it? Think about it as beta testing...
- P: Learning Creative Learning
- Marketing languge: http://pad.p2pu.org/p/marketing_message
- Philipp:
- there's too much, Mozz!
- Focus on what they want folks to know
- Why should I make a Badge needs the most work--what am I really doing if I create the Badge.
- Creating a Badge and Submitting a Project are two different things--and it's ok to split them.
- Start the sections with something active--do this thing. Use the active voice.
- Creator: The successful badges are ones where people want to build community around the badge
- Learner: finding cool things I could do, getting feedback, getting recognition for things I don't get elsewhere
- Why Should I Make a Badge sounds defensive???
- Discourse
- Replace mailing list with discussion forum
- Make it a prominent part of home-page / landing-page
- New P2PU members
- What is the ask?
- Is it continue the discussion?
- Is it build innovative technologies for learning?
- (What is the process to support them?)
3/5/2013
- Progress
- Assessment principles
- SCODA
- Open learning hackathon
- Priorities
- Process
- Stuff
- Open Learning Hackathon - 5/6/7 April
- 3/4 time vs full-time
- SCODA
- Who sets up landing page?
- Launch after badges at DML--
March 18th?
Curriculum: https://docs.google.com/document/d/1KbLoAvPsnxrTNqyeDtdvfDtJx4Wuub0taRv1V_X8Suk/edit?usp=sharing
- P's ideas:
- Create a prepare step that one person does, and a completion step for everyone to learn
- Have folks all work on 1 project instead of splitting out into their own
- Need to have more committment
- Maybe have someone sign up as a facilitator?
- You have to find a group to work with
- groups are between 6 and 12--you have to sign up with your group members???
- Signup with a group code???
- First person to signup becomes the facilitator
- We will kick off any group that has 6 people or more
- Timeline: closer to first of April--Dirk would have time first week of April for open sign-up
- 2 weeks of signup
- Build out tools we may need
- Doublecheck that the timeline makes sense
- P can double-check with Shuttleworth and ask for extension
Project Plan (outdated): https://docs.google.com/document/d/1x7_4Vlr16ioWKFqJS12Yo4yiX2JGqCQ_IeU9R1JASKs/edit?usp=sharing
2/26/2013
- Next week: should people group themselves? What would that look like?
- Next week: what can we get by DML?
- Badge application and awarding, splash page
- Secondary priority: sort/filter, badge creation
- Add one prime use case / examples
- School of Data timeline? OKFN owner?
- Dev projects
2/19/2013
2/5/2013
- Progress:
- Badges
- Personal Learning Plan
- Priorities:
- School of Data regroup
- School of Open badge map-out
- Notifications: thinking about doing a quick lit-review on this
- Problems:
- Insurance: Was able to move insurance to month-to-month (send invoice to money@p2pu.org / P and Ryan when it comes)
- DML: registration, flight and hotel arrangements
- Process:
- Performance Review
- Date:
- Prep: Read last one, make notes, consider old goals/discuss new goals, review and revise goals based on green/yellow/red discussion
12/18/2012
Progress
- Work on Assessment Manifesto (Vanessa walks through for initial feedback)
- MakerSpaces blog post
- Thinking through content strategy & blog ideas
- Community call ways to engage & visualizations
- School of Data MOOC design
- Hangin' w Dirk
- Getting zen
Priorities
- Assessment
- Googledocs Critique
- PS reached out to Google Research (waiting for response)
- What about github (or gitwriting)
- Stackexchange community for writers does a good job at this
- What would gitwriting look like?
- What is "my" project versus a group project
- Who is the individual, and who is the group
- Open Learning Hackathon - 5,6,7 April @Media Lab
- Doug Belshaw wants to talk about the way to move School of Webcraft forward
- Marisa--shall we connect her with June? She wants access to the data analysis methods as well
- this is another researcher in this space, independent research (not from p2pu staff)
- does she want all of the data and the logbook (which she can have if she signs an mou)
- find out what she's doing....
- Kickoff meeting, set up a calendar to check in, make it clear where the deliverables go
Stuff
- Content Party
- Develop a few challenges for thimble (but there's no funding available) but there's an opportunity for a really strong community
12/11/2012
Progress / From previous week:
- School of Data expedition - Lucy likes it / good plan moving forward
- DML ticket--booked
To discuss:
School of Games--please give overview
- what is the fundings source
- deliverables
Media Lab Learning course (title?)
To do:
Review badges scope document
Assessment Manifesto
12/3/2012
Mozz Progress
Mozz Priorities
- 1.) (tmr) 2 hangout use cases--DONE
- (push to next week) UX Sketch
- 2.) School of Data Sketch--DONE
- Staggered approach -> First three individual modules, only then form groups for project work
- High density version?
- 3.) Assessment manifesto--I think I've got a handle on this--the story is going to be driven by art critique model
- Who is going to DML? (Jan) -> VMG, and maybe AK--
- Staff call debrief
11/26/2012
- Priorities
- Q1 DML Badge Report (2 Pages) "Please send a short narrative (no more than 2 pages) detailing what you have accomplished so far, along with a budget showing your expenditures to dml@hri.uci.edu, at your earliest convenience."
- Budget: VMG's time so far, Dirk/Chris laying groundwork for badge system [PS and VMG do together]
- Minimum viable reporting
- Assesment UX
- P's feedback
- Separate project page--specific moment where you share project work
- Language/labeling is confusing--do you submit for feedback or for the badge?
- Add milestone page? Project review...
- Pull reflective question--might not apply to all learning contexts
- But course organizer can maybe decide if they want to add other questions
- Descriptions of red/yellow/green are too friendly
- Profile page: either there's something I can do, or something that makes me feel good
- What if my badge is under review?
- More information about *my* badges...when did I submit, when did I get it
- Assessment Manifesto (this week)
- In the studio model, there will be certain milestones, and you'll get critique from an elder
- In a way, badges right now only work for the final thing
- Do we want to try to make badges work for the other/increments?
- HASTAC Team--reach out with a call for proposals
- Progress
- All Hands Activities: Course Creation 101
- DML Progress Report
- VMG's happiness--increased 1000%
- Data--will see Lucy this week / Michael's email about expedition
- Disconnection
- What should a data expedition look like
- Evolve this through conversations-maybe a blog post
- Other
- Google Hangout extension
- 3-4 use cases courses P2PU has done, or would like to do
- VMG does before the 4-5th
- The blog post: potential for Google hangouts in education
- Mechanical MOOC ideas / thoughts
- 2nd step: are you ready now? click a button and only then they are grouped.
Vanessa's to do:
-Alex's blog stuffs
11/18/2012
Progress
- School of Data Update
- MM infastructure
- VMG figures out the when and the what
- VMG find out what the state of the data expedition
- What do you have in place
- Scope / Plan (timeline) School of Data MOOC - Agree P2PU timeline with Dirk/Chris/Philipp
- Deliverable: Project Plan for School of Data/MOOC
- Red Cross Assessment - 1 hour
- Course creation / School of Open Webinar
- Lessons learned:
- Prompt some pre-activities
- The course you want to create
- Specific questions about course design, platform or badges
- Have 2-3 slides, but mostly hands-on activities
- Reach out to School of Open people, maybe ask School of Data folks, maybe ask School of Sound crew? Beta piloteers
- DML November Outreach and Reporting
- Mozz does today, sends to P for feedback tmr morning
- Assessment Manifesssssto
- Feedback types
- Recognition vs assessment
- 1-2 paragraphs on vision for assessment
- ie we dont want to call it assessment--feedback and recognition
- pressure between studio model 1:1 feedback, mechanical mooc assessment
- our thinking around automated assessment
- what's the playing field, positioning ourselves as people who are knowledgeable in the space
- titles that are punchy and poignant--->build on 9 points in VMG's assessment plan, flesh that out, make it longer, and make it our assessment philosophy and manifesto
- audience: the interested layperson, will go on the blog-->well formatted publications, reports etc
- funders/Hewlett
- DML Community
- People building online courses
- possible collaborators
- How to think about presentation
- Badges Plan (see DML above)
Priorities
- DML
- School of Data
- Assessment Polemic
Other
- Insurance for Mozz
- VMG to investigate options--international health insurance
- See if you can find one that covers US as well
- PS to ask Non Profit Suites for advice
- Polemic
10/31/2012
Status:
- School of Open--Slides for webinar--almost complete
- School of Data--what to do next? Feedback on curriculum review?
- School of Sound--will meet up during music hack day--2 hours on a Friday to bang out curriculum--can we get an MIT room?
- Lightweight badge issuer ideas?
- Primary use case--people want to attach a badge to a course
- Recording or acknowledging that you've participated in the course
- Weirdly integrated with a course, but not integrated in the course
- Driven by the course organizer--you're free to set one up--but only people who have the badge can award it
- Two changes
- Badge description and criteria much more free form
- Only letting people award the badge who have the badge
- The person who creates the badge already has the badge
- Lit review of feedback (in process):
What kinds of feedback are most useful when?
Taxonomy of feedback in online communities
- unconditional love
- 3-4 categories the we've found
- and when are they effective, how are they effective (1 on 1 vs public, online vs. face-to-face, beginner vs. intermediate)
Bring in experts at first round
VMG's To Dos
How do you make sure than people *get* useful feedback
mozz does a lit review of instances where people get useful feedback in online communities
if people know how to give good feedback and get feedback, they are likely to develop community skills that transfer out of the community
and getting better at their particular domain
deviant art: http://www.deviantart.com/
scratch: http://scratch.mit.edu/
chefhangout: http://www.chefhangout.com/
What's the quality of the feedback?
What's the size of the community?
How quickly are people getting feedback?
Deviant Art:
19 million members, 100 million pieces of art
Check out the expansive community management staff: http://about.deviantart.com/
Feedback is very subjective, and mostly completely positive or completely negative: http://cl.ly/KYJq
Chefhangout:
Colored bar to encourage sign up: http://cl.ly/KX0F
Mother company is "Hangout Planet"--a whole business model around hangouts
Learners do ask questions during the session
Private sessions available
Skillshare Hybrid
Prep materials: https://s3.amazonaws.com/skillshare/assets/hybrid/How+To+Teach+An+Awesome+Skillshare+Class.pdf
Courses must be 'approved'
Skillshare courses have a "project gallery" separate from "discussions" http://www.skillshare.com/Strategic-Brand-Communications-for-Entrepreneurs/1081214123/452179651#projects
No feedback mechanism from peers apparent--looks like instructor evaluates all of them
VMG's Trello (for reference): https://trello.com/board/vmg/4fcf782d4cbc32e05904a080
- Unconference at DML
-
10/23/2012
http://101.edstartup.net/
richer references
how do we enable people to expermiment and innovate?
-explore working with wordpress plugins?
django apps--have to do it on the server
research q: look at where discussion/community happens and if it happens
what was it about P2PU that made the experience so good? what's the secret sauce? (clearly *not* the technology) or clearly the accomplishment of being in charge of your own learning
Step towards a different DML conference
Why should we do this
assessment
sep vignettes
take bullet points from assessment plan
think about examples
do
VMG
-Assessment plan
Prep for VMG review--what is needed?
Fiction with Sam Allingham
Alex Hillman visit
Can we swap out "assessment" and "feedback"
VMG answer: what makes good feedback?
--Do we have to answer the question "I have achieved something!"
How can you say that you've taken a course?
Blog post--we dont want to scale
We want to get small groups of people together
Simple interface where anyone can make any badge they want
Almost no limits--totally up to them how people want to use it???/
Beyond those fields and the submit button, does there need to be anything on the badge
Not P2PU badges--just the issuing platform
We watch what happens
What is the most minimal thing that is totally abusable???
Value of the badge depends on the work behind it
"Small is beautiful"--PS
TWO PROJECTS:
1.) Badge review/creation UX
Minimum viable product
Take it out of lernanta--external to lernanta
on the last task, you make a link to the image, and you put in your page
takes the user to the other place external to lernanta
2.) Robust feedback project--crusade for better feedbacl
3) Outstanding projects--how do we rack 21st century skills??? (Maybe roll this into number 2--collaboration, communication) and call it a day
VMG Priorities:
- SoundCloud Event - http://pad.p2pu.org/p/Soundcloud-MIT-Event
- DML Materials Prep
- 8.5 x 11 sheet of all badges in ecosystem
- 3 lessons learned and a bit of a presentation on how our system currently works
- For unconference--a presentation and discussion on what to do if people create bad badges
- Assessment Plan Revise
- Mechanical MOOC
- DML Research Coordination
Other things on radar
- Mental Models Research-->kicked to October
- Treehouse collaboration--->will kick to P, but vmg really wants to do
25 Sep 2012
- For discussion -> Should we try to use PPPP format (Progress, Priorities, Problems, Process) for these calls?
- Thoughts on peer review / assessment literature - relevance for badges platform
- School of Data
4 Sep 2012
- Assessment feedback / call
Philipp's Feedback to Assessment
- Example: In each week, you'd be doing different things
- Doesn't feel like delivering really useful feedback
- Tags feel too prescriptive? Tags could be aligned with one line in a rubric, to reflect levels of achievement [maybe use a slider?]
- Use rubrics for self and peer assessment
- Make it really clear what people are aiming for
- Use Red-Yellow-Green feedback in the tags--make it more granular
- Ideally you could indicate what's missing and what's good in the feedback
- Improve the way people give feedback
- Find assessment paper on Stanford AI
- Are there too many skills per courses? Too much? Too overwhelming to a course creator? Suggest fewer skills but more detail, drill into one skill
- Tags would work well for 21st century skills--offer a suite of generic P2PU 21st century skills
- Think about ability to rate the feedback, give feedback to the feedback--->using that as assessment
- Experts: for the document, take out the detail-->add "we are looking for ways to recognize that some people are experts"
- Think about pyramid of expertise--person who creates the courses is the sort of "original expert"
- As people get badges, they also become experts, so we increase the number of people involved in the expertise-recognizing process
- Issues of cheating/consistency
- Person who has the badge has intrinsic motivation to protect the integrity/value of the badge
- Think about people who have the badge becoming stewards of the badge--more community protection of the badge/recognition
- Transparency--we're happy that the badge means different things to different people---if the badge is essentially a hyperlink to the work and the assessment behind it, so easily verified
- We don't worry about consistency at the badge level--there is no consistency--we'll make the work really transparent
- Community member reactions
- Put in suggestions for changes
- There are 21st century skills that are distributed across P2PU
- And then there are other things that are tied to an artifact--the other skills are tied to making that
- A course is where you make one thing
- Call each task a "page"--via Dirk--very interesting idea--not so suggestive of what it should be--have a special type of page--"capstone"
- Tie all the assessment to that page
- So it's applicable to only that page
- How do we encourage people to resubmit--and improve
- If everyone had their own project page, we would be able to track revisions
From Dirk:
II.
- This section seems a little short since these are the problems that
we are trying to address. I'm guessing you may have done so on purpose
though, so not a big problem for me
- Complexity: is this really a problem? Mostly for badge creators or
for learners when they need to apply/review?
III.
- Will badges be decoupled from courses and schools? I kind of like
the idea of badges not being specific to a single course or school
- How do we determine if a users is experienced?
- I like the idea of skills being more prominent. Maybe we should
limit tags to skills or rebrand tags as skills? They both can also
coexist.
-- Something like searching for courses by skills could be a good way
for people to find courses
-- Showing "Learn more than 1000+ skills online with your peers" and
some popular skills on the homepage can be good for PR
- There's a missing "are" in "There definitely experts among us"
- I don't completely understand the expert user pop-up box - is it
some way to ensure that a user is actually an expert?
IV.
- Will skills be tied to content/schedule? "skill acquired by week"
- Does course creation and badges correlate? Are badges created inside a course?
- Should learners see all the skill that they can learn in a course?
- Would skills acquired in a course be limited to the skills defined
by the course?
V.
- Should we introduce the concept of groups/cohorts at the same time
as assessment?
VI.
- Can we maybe show an example of what the visualization would look
like? Would it take manual input or would the skills graph be
automatically generated?
-- I like this idea!
- Does this correlate in some way to the "Knowledge map" from Khan Academy?
VII.
- Great feedback from excellent people!
- Where is the "why is this plan an improvement" section that Allan mentions?
General:
- How do we display evidence for badges?
- Do we show evidence per skill?
- Are skills 0/1? IOW, does it take only 1 peer to believe that I
mastered/have a skill?
- Does being tagged with a skill mean that: "I mastered the skill",
"Discussed the skill", "Improved on the skill"?
- Sounds like there is an expert user role that's not being explained
by this plan? Something like a user that makes an independent
assessment of a users skills who's feedback we can use to test the
effectiveness of this plan?
Next steps:
Reduce scope of example--pick one week for a course and make one
Think through and resolve questions outlined above
Tie the assessment to the project itself--or the deliverable
8/28/2012
- COMPUTER--->mozz needs her Keynote
- Confab
- Assessment
- SoundCloud
- DML state of affairs
- Script: Chris can and will write
- Materials prep for DML/Duke: https://docs.google.com/document/d/1B-D5-6HeLRvON7GIst_SbKFhO9mFVWU2Z6P0fVnE2N0/edit
- Other thing
- Badge development
- Connect with DU
- Decision about retiring some types of badges (and then communicate)
- Discuss this as part of the assessment discussion (next week Tue)
- Mechanical MOOC
- How do we track bugs / issues?
- Mech MOOC certification
- Freneticism
- Red Cross
8/20/2012
VMG goes to Mozilla (Nov 9-11 2012)? https://donate.mozilla.org/page/contribute/mozfest2012-registration?source=20120808_wave1
- We could meet with OKFN peeps
- LOL: if you want to go, you have to do something
- VMG: find promotional material--find out if we can get a travel reimb.
Thinking about applying to speak at Confab: http://confabevents.com/news/confab-london-open-call-for-speakers
- Content Strategy for Community Driven Organizations
- UGC can coexist with CS
- This is *important* to VMG. Top conference to go to in the year--->what about conferences I *don't* speak at, just want to go to find out more? $ for personal development in 2013.
- VMG applies--will either get to London or to Mpls
Computer: FWK took it back :(
MIT/Soundcloud event: http://pad.p2pu.org/p/Soundcloud-MIT-Event
- Looks flippin awesome. Is there anything you need from me?
- Let Dirk and Jose about it - maybe an opportunity to use/test the P2PU API and maybe Jose can attend (he is in Boston a lot)
- P to ask Mitch about Sep 29, Oct 6 [P can't make it] and Oct 13
Mechanical MOOC: http://mechanicalmooc.org/
- Introduce to the community list? So people will know it's coming and how to promote etc.
- Are we ready to deal with any tech issues/ troubleshooting (question for Dirk rather?)
- SC: posing additional feature requests, changes to the page
- Where is he logging them?
- Use github issue tracker
- We still need to write the script!!!
- VMG asks June: Uniform expertise mix--will that reduce the randomness so we aren’t able to test the things we want to test
- Build the script? https://docs.google.com/document/d/1n8pykjU3pBVUb1MPkP1DYbfBXIF9JtjCh6ts9os6ll0/edit
- PS to ask JDB to write it--hopefully he will!! :) - email sent, will have to make a back-up plan if john cannot do it
DML Research & June: http://pad.p2pu.org/p/DML_Ahn_Planning
DML Webinar and blog post
"What if People Create Bad Badges?" blog post: http://info.p2pu.org/2012/08/15/what-if-people-make-bad-badges-p2pus-plan-of-action/
User tests of new homepage mockups:
Course creation research project
- VMG to present results next week
School of Open badges
Assessment plan
Topic of conversation: Recruiting innovators
Excelsior College is interested in P2PU learners taking tests for credit: http://pad.p2pu.org/p/excelsior
8/1/2012
$: Vanessa hasn't gotten paid 8/1/2012 :( - PS following up / sent an email to non profit suite
Mechanical MOOC
What do we need to have ready for the announcement?
- Sign up mechanics (how integrated into MIT OCW site)
Plan to avoid Mechanial MOOC catastrophic failures
- What about auto-responders?
ELIG OE Book: how do you want to do this?
- We can't do it. PS sending email now.
Assessment Plan:
- VMG talking to Paul Oh from NWP & working together on assessment plan
- Connect with Karen. P2PU <3 Karen.
MIT Medialab Space for Soundcloud/P2PU/Medialab (choose your order) event
- Need 6 week prep time/ onramping
- 60-80 people (roughly 50/50 story tellers/developers)
- VMG does learning activities and brings storytellers, Soundcloud brings developers
- P2PU facilitates
- Medialab provides space
- SoundCloud provides food/drinks [Check with Paul]
- 1 day event
- Date: September 17th (tentative)
- Goal/Objective:
- Connect learning and story-telling on the web
- Connect hackers and story tellers
- Make project-based learning exercises & test them
- TODO:
- PS to send email to Mitch/Joi about this
Cohorts
- Is content vs. community really the question?
- Is this a complicated discussion?
- Minimum viable product--create a course, and then create a group of people associated with that course
- Next step: all the complicated stuff
- Multiple cohorts on same course content?
- Cohorts--means revamping the course creation process
- Next Steps:
- Smaller groups, social norm to help course organizers have a course that has 4-6 people, encourage courses with 4-6 people
- Is there a way to spawn more courses of four people
- A button--"this course is full--start your own"
- Are they succeeding? Are they clicking the button?
- And then either no one does it, or everyone does it...
- Roles: experiment with that in small courses--courses that have personality
Vanessa's Graduation Date
December 2012--full time P2PU
////
Steve Carson's Open Fiction Project
Next time:
PG Law's Hewlett Research Grant
Today:
- AIZ visit on Friday
- e-learning team (academy of international corporation)--if you're being sent to Ghana for a local water purification plant
- HOW CAN THEY STAY IN TOUCH WITH PEOPLE AND MAKE THEM SELF-LEARNERS
- They have a platform with some struggles
- "This is how a P2PU course works Intro--what worked and what didn't work"
- evolution of P2PU
- structure a few of their courses as P2PU courses--and run them through P2PU--our unique selling point is that we have a different model which is p2pu--that people are more engaged and we learn more
- 11am: this is what a p2pu course looks like, philosophy, what is special about it, how would you build
- test the things you show
- see if it makes sense to them
- Learning Theory
- Connect with June--script written, but radio silence
- Assessment plan:
- feedback from Philipp: what are the problems that are trying to solve
- P: looking for a deductive, evaluating process
- VMG needs to assure P that we can mak a system that won't be gamed ;-)
- VMG needs to pick several courses and look at the them in this way: Copyright for educators, School of Data-->what would the granularity of skills look like, courses that have black or white assessment---look at tagging versus rubrics
- Two Qs
- Compare tagging to rubrics
- How do you tie the assessment to the learning and the community?
Select a School of Education course & Webcraft where this process could work-->draw it out to send to P with very real examples
Negative feedback in a tag w/b hard
Self-assessment first
Describe the evolution from rubrics based assessment to tag-based assessment
What does it mean to "totally know"--how do express range of mastery in tags
Should all tags be available at all times? community practices (feedback etc) vs. mechanics (specific to course)
Apply by email--c/b a next step in the plan
3 course examples with tagging by Friday, July 20th
Copyright for Educations
Processing
User Experience Design
Ask Karen for a recommendation--this is how we're thinking about doing assessment for this course--get feedback from her
What tagging can do in the context of "adding up" to stealithy awarded badges--badges become a synthesis of different skills, represent habits, as opposed to a 1 skill: 1 badge system
LEARNING THEORY
Does someone who wants to run a fairly traditional course--do they fit into our learning theory?
Does someone preparing to run a school of education course--some of these are the most successful
7/9
* MOOC Script
* School of Data: Hosted on P2PU
- part of me wonders if we should be *more distributed*
- how can we tie the data to our user accounts/make use of it
- the more ownership spread around the better
* Working with Sam / Designer at OKFN - Intro done / PS
* Badges / Paul Allison
* Performance Goals
* Intro to Lennon Flowers (Ashoka) - Done / PS
7/3
- Mechanical Mooc - Codecadamy delayed
- NSF / June's email
- Feedback from your German workshop on slides
6/26 Agenda
6/19 Agenda
- Questions for sign up form
- Challenge Resources--port this content over to
- Knowledge base
- Create a challenge
- A blog post about these resources--for VMG to do
- VMG to do: June for input in cohorts research
- Just in case we have time:
6/18
- Cohorts Research: http://pad.p2pu.org/p/Cohort_Research
- PS: Added notes in the etherpad. Look forward to discussing!
- MOOC next steps
- Mechanical MOOC homepage
- What questions to ask for MOOC sign-up?
- Learning Metrics: course organizers & video
- Do it with the people you want speak to
- Help you make pitch/explanation better
- End goal: surface learning patterns that will help everyone be a more successful peer learner
- Support facilitators in their work (mentioned in video)
- Challenge Resources: https://docs.google.com/a/p2pu.org/document/d/14u8vOnvFSQ87WqMyAwbQPhNrvNzrQ2RUFmyE7q5oNRI/edit?pli=1
- What happens to previous tasks?
- Clone this one and then edit it
- When you delete tasks that someone has completed, do you break anything
- But if you clone, you lose your community
- VMG & PS: would prefer to update the one we have
- Message to challenge folks: we're improving it, tell folks about
- VMG travel (will put in calendar): Weds of this week, leave for Warsaw 6/26, Stockholm 13-16, Vanessa will stay 20-21st
Plan
- Overall goals
- Use badges to support / encourage / facilitate P2PU style learning
- Award badges as meaningful alternative credentials
- Advance the conversation and understanding of learning & assessment on the web
- 1-3 month objectives
- D1 - Theory of learning
- Articulate our vision for P2PU learning -> creative learning supported by peer-feedback (=assessment)
- P2PU learning habits = 21st century skills
- Make the case that this type of learning is more likely to foster 21st century skills development
- Result: Theory of learning text
- D2 - Review current assessments/badges practices
- (a) What are the assessments leading to skills badges? What's working? What isn't? What do we need to fix?
- (b) What are the assessments leading to habit/practice badges? What's working? What isn't? What do we need to fix?
- Result: What we should change & a blueprint for what this should look like
- D3 - What should we do about the assessment paper?
- Take 8 practices
- Make changes in voice & tone
- Include examples for each
- Consider grouping or extending the number of practices
- Badges are issued as a result of learning experiences in schools tied to domain specific (knowledge &) skill
- School of Data /Open badges
- 3-6 month objectives
- P2PU learning habits are recognized through badges (=How do we assess 21st century skills?)
- Schools can create badges for domain specific knowledge & skills without P2PU intervention
- 6-12 month objectives
- General badge creator / issuer functionality for domain specific knowledge & skill
VMG to do:
Good list of practices, but hard to "make it real"
We're going to P2PU-ize 8 practices to test what they are like in action
13 June
- School of Data -> How can we help people develop challenges (it's hard) - what materials do we give them / feedback / review
- For individuals, its put up an run a course, but what's the answer for pitching organizations
- Previous materials are too abstract--very friendly, not very concrete
- What's a kit that we can deploy at workshops (don't make the next one until workshop in July)
- Association games--didn't work for everyone
- How is VMG going to review these courses? What is the right time?
- Making peace and finding happiness in the assessment papers ;-)
- Badges next steps? http://pad.p2pu.org/p/product-discussion
- Revision of Assessment Plan
- Add notation of learning theory to designs
- Plan to answer the question: are your assessments reliable
- Plan for testing them
- Mechanism for transfer into an official system
- Ie College Unbound: we build out the peer review mechanisms, they CU does an expert review, and they compare the two at the end
- Badges blog post
- Next steps: P to look at blog post
Two goals for assessment
- Explain how you can do assessment in peer communities online
- If you're a peer learner online youre more likely to develop 21st century skills
- Here's how the assessment of tomorrow helps us surface those skills
- Is certification one way to connect formal and informal learning environments
- People get jobs based on badges OR badges transfer to the university setting
- Curriculum development
- What do we care passionately about that should be offered
- Is there some valuable data about what people are searching for
- (Sep. step: certification--different conversation)
12 June
- Background on course creation/course sign up in dev priorities
- VMG keep consistency in mind when you evaluate each part of the site
- This will happen piecemeal--come up with a stylesheet???
- Voice and tone
- Learning Analytics / Sharing dashboard
- Feedback on protocol? https://docs.google.com/a/p2pu.org/document/d/1L3DGO1XehoGETWRfZvkr1h1oECXIQdKTkjNYGJHx1Hc/edit
Compare organizer data month over month- Post interviews to site?
- P feedback:
- P feedback: it's a bit long
- Are we asking the right people about the learner experience
- We're thinking about exposing this to learners--do you have thoughts on this? Would you be willing to review prototypes
- June: how do you expose this to prompt help
- VMG: talk to one or two people, come up with a prototype and test it
- Do we show learners the data we have on them, or on everyone?
- Maybe it's a bit too conceptual at the moment
- Curriculum development (from SSA)
- http://www.slideshare.net/lrosenfeld/search-analytics-for-content-strategists
- Analysis of site search analytics to build out curriculum targets
- Open University that they had 3 audiences: current students, potential students and staff
- Next steps:
- find out how much searching is happening at the moment
- find someone else to do it (either on team or community) and help them get started
- analysis of SSA, share with team, action plan for building out
- Theory of Learning (from conversation w K. Brennan): https://docs.google.com/a/p2pu.org/document/d/1pJlochQa9JDQheNhBcO2pNTefFwSnFHPXT7unOsDrf4/edit
- Who is the audience for this?
- P2PU itself -> shared vision
- New users -> attract people to P2PU
- Partners -> communicate the value we bring to the partnership
- Rearrange order (How we Learn--->Who we are-->The Future of Learning?)
- Is it too consumer-centered, not enough of a call to action (could change the voice to "you)
- Q: How aspirational vs. descriptive do we want it to be?
- If you feel the need to add texture, do so.
- Learning projects--maybe we're a step too far ahead: frame this more carefully
- What do we mean by a course?
- More encouraging
- Define learning project?
- Instead of describing a learning project, describe how people learn
- Where does the spark of personal interest start?
- Serendipity--designing a space so that maximum serendipity can happen
- We want people to have epiphanies
- Can be longer
- Worth looking at -> http://erinknight.com/post/17326314073/working-learning-design-principles
- Recruiting folks to come talk to us at Berlin: what next steps can we give them to get involved in our community
- Run a course!!!
- Remind P to be extra friendly
- Ask people who are there to talk about the projects they are working on? Have everyone say a sentence about what project they are working
- Relevant Trello boards?
- Insurance: Send to Bekka
- Karen Brennan is Vanessa's advisor moving forward--YAY!! - Great!
- Badges next steps? http://pad.p2pu.org/p/product-discussion
- Mechanical Mooc next steps
- Develop rough outline based on MIT materials
- Week 1, Week 2 etc-->just point at stuff
- Need a correlation bw Codecademy & MIT course content
- Find out from Steve how to map to Codecademy tutorials
- Manual email sending process
- How do we want to group? What additional info do we need during sign-up?
- diversity of skill level is important--results from self-assessment?
- level of privacy--from completely open googlegroup to completely closed
- experiment--see what cohorot variables work best (3-4 max)
- qs: demographic data AND helps us put them in groups (what aspects do this double-duty?)
- maybe answers to some hilarious but arbitrary questions: ie what is your favorite barnyard animal? Your preferred superhero? Gives people something to talk about.
- What are deadlines? http://pad.p2pu.org/lab-project-mit
Next week big deadlines-->
- Research Workshop?
- Assessment Plan at 3, 6 and 12 months?
6 June
- Review older notes (no loose ends)
- Set up weekly calls
- Mention performance review plan-->so we should prepare a list for Berlin? Think about it, but nothing formalized.
- Start thinking about next steps for:
- Articulate a theory of learning for P2PU that we can focus and test
- Draft a vision for our assessment program over the next 3, 6 and 12 months -> need a plan
- Evaluate the current user experience from a learning point of view and present design improvements -> first steps?
- ... What about badges? -->yup
- Learning Analytics: ideas for additional content. Can we visualize the data of self versus rest of course?
- v2 draft:
- Tasks completed (out of how many started? In challenge? Total?)
- Badges earned (number and classification--habits/skills)
- Times logged in? (are they logging in and not answering/struggling with the task)
- New threads
- New comments on others
- PS: Can we turn it on for all course organizers? If we do that right now, that wouldn't be a major development overhead. Is there any impact on quality of courses, or satisfaction of course organizers?
- VMG thinks through it: turn on right now? think through the way we can measure impact of making available to folks
- pick 2-3 people and check in with them 3-4 weeks from now?
- Ideas for improvement (v2)
- Theory of learning: next Friday-->June 15 (present at Community Call?)
- Sep. from voice and tone
- Present to community
- Put on the site: learning theory is the next iteration/level of core values: openness community peer learning
- Moocs: what is the core content? What are the assignments? Is this a good candidate for relay challenges? Separated out by role? Or mystery--how can a mystery tale unfold here.....
- FYI now the "Mechanical MOOC"
- VMG: drafts automated email--once the cohort is full, here's your study group, here's the materials for the week, P2PU scripts the course
- Next steps are project plan (original dates were very ambitious)
- https://docs.google.com/document/d/1KFRec2EkKG_FpCL7XUFBV3kamxqgEPp3_5-As8IhXXM/edit?pli=1
- http://pad.p2pu.org/p/lab-project-mit
- mailing lists for each cohort
- VMG: getting those emails right
- low tech approach to getting people to work together
- if you can figure out a way to save progress & show it to someone else (maybe screenshots)
- BONUS/STEALTH TASK: can we find a way to have cohorts work on actual projects together /create codecademy tutorials
- Core questions: can we create cohorts & how do we know if this worked?
- State of badges blog post-->Thursday, June 7
- Duke--VMG signed up (conference $?)
- Research w Luka
- Get all this on a Trello, geez VMG
- Onboarding left to do--$$
- Chloe--mentoring?
Next call:
- June Anh / Research relationships / MoU
- Insert research questions into MoU (agreements)
- Add to P2PU responsibilities -> Create a public page for the MoU and research project description
- Two goals for research -> Answer important questions for the field, Help P2PU get better
- Deliverables and timeframes
- Attribution (Recognition)
- TODO:
Now: VMG to update MoU (VMG don't forget to update the date)- PS: reply to the lawyers with VMG on copy
- "Later": Develop a strategic plan for research unit
- Consider the revenue aspect of each research project (we need to fund the time we spend on research)
- VMG thinks about: Research Unit of the Strategic Plan
- Articulating learning theory
- P2PU's voice and tone
- Storytelling aspect of Sep's project--balance inspirational (but not self-congratulatory)
- Voice and Tone
- P likes short length--if you wanted to dig deeper, you can (brevity)
- VMG does 3-4 "this and not that" (but it's not the official voice)
- Ask P, Bekka, and John B
- Model the voice you want to hear
- More writing - Blog post about badges (where are we / what is going on) [VMG send Philipp draft Sunday]
- State of where things are--
- Etherpad with template of the badge
- $$ from DML
- DIY badges
- Future direction--where we might take them
- Todo: VMG to ask Stian for access to the blog
- Start date - two weeks from today -> June 5th
- Book contribution
- Berlin "Learning Labs"--research workshop that trains P2PU to help plan research projects
- Approach 1: Dry run of courses being developed
- Approach 2: VMG to do some thinking about how to frame research workshop
Contract
- Sent off to lawyers - waiting for updated version (MA instead of CA, etc.)
- Question about current contract
Discussion
- Feedback on email / draft [Practical question -> where do we put this doc so it allows collaborative editing? (GDoc, Etherpad, ... ?]
- It's about assessment as a core practice (=feedback / peer learning) -> I like that!
- Learning projects <> courses
- Would this require a major redesign? <-- that would be hard
- Or can we start by helping people "design" courses that enable the kind of learning we want to enable
- Room for rubriks? Research in formal education shows that people are good at peer assessment if they understand the rubriks / get help with the assessment
- Does understanding the rubriks lead to higher "reliability" of the assessments?
- Does understanding the rubriks lead to increased learning by the assessor?
- Badges are peer-awarded but with power user / reviewer input
- Special peers -> Why building a back door for an expert reviewer is necessary (for now)
- Provide validation of peer review (important as organization's reputation may be attached to the badge, e.g. OKFN, CC)
- Data for comparision and further research
- Ability to spot problems faster and iterate
- Expert assessment=control?
- Peer assessment=variable?
- Way to test how accurate peer assessment is....
- Expert reviewer--doesn't have to be an obvious step--someone that potentially OKFN recognizes
- Before the badge pops up--the expert reviews the work, stores their own assessment
- Expert may have veto power
- What is the role of facilitators? (most common request for challenge UX improvement)Facilitation:
- Gets people unstuck
- Rallies others to get unstuck
- Then can model values and habits
- Joy's awesome nonprofit: tutor speaks as little as possible
- P-facilitators can model habits, if there's a bully, facilitator keeps them in line
- Facilitator vs. Expert--not nec same role
- Feedback
- Challenge is that users are not giving a lot of feedback to each other
- Articulate this to the user that feedback is an expectation of this culture
- Goal: more feedback, because feedback is assessment, and leads to learning (for both, givern and receiver of feedback)
- Strategies:
- Make feedback easier /faster -> Tags allow quick feedback
- + relatively easy to implement
- + widely used and high chance of adoption
- - less meaningful feedback (less opportunity for learning)
- Create stronger incentives to give feedback
- - hard to do
- require feedback to consider your project "submitted"?
Next Steps:
- (1) Articulate vision for P2PU learning
- Plane 1: Learning happens by assessing others. (Peer feedback = assessment = learning)
- Plane 2: Learning occurs by working your way through creative projects.
- Plane 3: Learning is enabled by habits, such as curiosity, exploration and risk-taking.
- Plane 4: Learning happens by working with others.
- Plane 5: Peer learning fosters development of 21st century skills
- Todo: Review a set of existing courses at P2PU and how to apply these planes
- Todo: Define measurements
- How do I know what to do? Where to start?
- Discovering what people are working on -> showcase
- Tutorials to get started -> courses
- What is a course?
- Designed for individuals to find, define and pursue what they are passionate about
- Consider using a "vignettes" format (similar to http://farmerandfarmer.org/mastery/index.html
- Find a better title (not learning theory)
- Use some of the content from assessment framework (e.g. the "contours of community" section could be one vignette)
- (2) Skill badges - use current system (pilot -> school of data)
- What changes are required for current challenge UX?
- Screenshots with annotation? [vmg take screenshots of what you'd change--what would be the first step?]
- what things about Challenges really conflict/break with the learning model that we're trying to move towards?
- (3) Habit badges - how do we get started?
- maybe what is special about P2PU is habit badges
- VMG: what should that look like?
- Expectations from School of Data and School of Open about their assessment programs-->how does that inform the next few months?
- There may be an opportunity to test some of the ideas in a low-tech way