idk what it is about conversations that allow them to draw insight out of you with ease. Looking at prompts and exercises in workbooks, I don’t feel motivated to work on them. It’s different than if I imagined someone asking me those Qs. The latter feels more effortless and engaging. I guess this is what…
Author: tre
So. As part of my latest attempt in untangling this writing paralysis, last Tuesday I promised my therapist to publish two posts to Substack by the end of today. I had one full week but only started dusting off my writing environment on Saturday. Tinkered with some drafts, captured new ideas, but unable to fully…
Why do people want data? What do people use it for? What are they trying to do, really? Put simply, four verbs: Decide, Monitor, Create, and Automate. Let’s first look at something called the JTBD framework. JB.. what? Jobs-to-be-done. Here’s a good description: https://www.productplan.com/glossary/jobs-to-be-done-framework/ The jobs-to-be-done framework is an approach to developing products based on…
I know I said we will look at different ways people use web data this week, but I realised there’s one other thing related to the six challenges worth discussing before moving on. It is the different levels of readiness / maturity when people embark on web data projects. I call it: “data-needs journey”. By…
Hello again. We have three more challenges to cover: Maintaining, Cost, and Quality. Let’s first do a quick recap. We have covered the first three challenges you can run into in web data acquisition projects: Setup, Banning, and Scaling. Now, in order to properly talk about the challenge in Maintaining a data acquisition project, let’s…
Unbounded freedom, infinite possibilities, and illusive empowerment can make the best prison. What do I mean by that? One example: The things I’m currently insecure about are things I think I can change: thinning hair, protruding belly, and verbal communication skill, to name a few. While my flat-bridged nose or square jaw feel more “it…
Sometimes you find that your current setup doesn’t give you the sufficient data to achieve your business goals. You might feel the need to increase the frequency, add the breadth of the data collection parameters for example keywords, zipcodes, categories, or add new data sources. You need to scale the project. What do you need…
The second most popular question people ask when they learn that I work in the web data collection / acquisition space is “how do you go about banning?”. Could you guess what the first question is? And no, it’s not related to the first challenge we looked at last week: Setup. One hint: if this…
Hello friend, I’m reporting back 7 weeks into this mini retirement and I just want to say that I finally begun to feel more rested. I resigned mid May, interestingly one year since I published the “I can retire but I don’t” post. I survived the excruciating 2.5 months of extended notice period till the…
Let’s dive into the first common challenge in data acquisition projects: Setup. You can find the previous post in this series here. How do you get value from web data? What does the end to end process look like? What questions should you be asking? To reiterate the context, the use case that I’m covering…