I know I said we will look at different ways people use web data this week, but I realised there’s one other thing related to the six challenges worth discussing before moving on. It is the different levels of readiness / maturity when people embark on web data projects. I call it: “data-needs journey”. By…
Hello again. We have three more challenges to cover: Maintaining, Cost, and Quality. Let’s first do a quick recap. We have covered the first three challenges you can run into in web data acquisition projects: Setup, Banning, and Scaling. Now, in order to properly talk about the challenge in Maintaining a data acquisition project, let’s…
Unbounded freedom, infinite possibilities, and illusive empowerment can make the best prison. What do I mean by that? One example: The things I’m currently insecure about are things I think I can change: thinning hair, protruding belly, and verbal communication skill, to name a few. While my flat-bridged nose or square jaw feel more “it…
Sometimes you find that your current setup doesn’t give you the sufficient data to achieve your business goals. You might feel the need to increase the frequency, add the breadth of the data collection parameters for example keywords, zipcodes, categories, or add new data sources. You need to scale the project. What do you need…