One thing I'd hoped
[2023-05-30 06:23:07 AM] : One thing I'd hoped to do with my new workshop was find a way to get some insight into how students progress through it, where they get stuck, that sort of thing. I'm using my own course platform which kinda helps with collecting raw data (like events every time someone completes a lesson).
But I didn't want to spend ages building out reports and decided to give MixPanel a go.
The initial results are pretty encouraging. Here's a diagram which shows how students progress through the main project in the workshop. There are hints and tips built-in, but this is the first time they really have to take what they've been learning and apply it.
I had some feedback from one person saying they found the project far too complicated, and had to jump to the solution to figure out how to make it work, so I wanted to check that against more data points.
My initial analysis of this graph is that there is some drop-off through the project, so I'm going to look at ways to make it more accessible, maybe be more explicit in the early stages, also check the content prior to this part of the workshop is providing a solid enough platform for them so they can jump into the project when it arrives. [File hidden by Slack limit]
1 Reply
[2023-05-30 11:47:23 AM] : that is cool jonh! this is the sort of analytics I've long wished for in any course platform. do you log the events directly into mixpanel, or something else?
[2023-05-30 12:22:28 PM] : So I've considered calling MixPanel directly from my code (and probably will in the end) but as a short-term way to just get the data in, I stumbled upon HighTouch.
It would be too expensive for me to use beyond its free plan. But within the limits of the free plan I was able to use it to fetch the relevant event data from my database and sync it to MixPanel as events.
As I mentioned, I think my ultimate plan should be to write directly to MixPanel from my code, and basically chuck every event I can at it! :sweat_smile:
[2023-05-30 12:31:36 PM] : Cool :raised_hands::skin-tone-3: