So. As part of my latest attempt in untangling this writing paralysis, last Tuesday I promised my therapist to publish two posts to Substack by the end of today. I had one full week but only started dusting off my writing environment on Saturday. Tinkered with some drafts, captured new ideas, but unable to fully…
Why do people want data? What do people use it for? What are they trying to do, really? Put simply, four verbs: Decide, Monitor, Create, and Automate. Let’s first look at something called the JTBD framework. JB.. what? Jobs-to-be-done. Here’s a good description: https://www.productplan.com/glossary/jobs-to-be-done-framework/ The jobs-to-be-done framework is an approach to developing products based on…
I know I said we will look at different ways people use web data this week, but I realised there’s one other thing related to the six challenges worth discussing before moving on. It is the different levels of readiness / maturity when people embark on web data projects. I call it: “data-needs journey”. By…
Hello again. We have three more challenges to cover: Maintaining, Cost, and Quality. Let’s first do a quick recap. We have covered the first three challenges you can run into in web data acquisition projects: Setup, Banning, and Scaling. Now, in order to properly talk about the challenge in Maintaining a data acquisition project, let’s…