Serverless Analytics (Statsbot / Cube.js)
Data
web analytics
SHOW HN2018
Serverless Analytics (Statsbot / Cube.js)
Serverless Analytics Built from Scratch
statsbotco.github.io#web analytics#serverless analytics#google analytics alternative#cube.js#aws lambda
How HN took it
4 positive, 16 neutral or asking, 0 mixed, 5 critical, out of 25 comments about the project. Thread score +0.02.
Idea: 1 for, 2 againstExecution: 1 for, 2 againstPerformance: 0 for, 1 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Interesting and nicely presented
From 1 comment
Interesting and nicely presented! I built a prototype of something very similar, but using Google BigQuery to store and extract data[0] but never took it beyond the concept…
gingerlime on HN
Clever meta idea of a serverless analytics tool featured on HN
From 1 comment
Build serverless app to track web stats. Get it featured on Hacker News and use the flood of traffic to demo what was done. Very meta. Nice job.
code4tee on HN
Objections
Cannot replicate Google Analytics session and user metrics
From 1 comment
I mean as a POC its not bad, but google analytics is not the same as analyzing server logs (contrary to what most people would suggest). Most of the value of ga comes from…
soared on HN
Vulnerable to bot and scanner traffic corrupting data
From 2 comments
This sort of thing works until you have one person run a security scan on your site, corrupting your user agents and event types.
teej on HN> google analytics is not the same as analyzing server logs This is what most people don’t get with ga. Google Analytics does the heavy lift by removing incoherent , corrupted or…
asien on HN
Endless loading bug
From 1 comment
Endless loading... I think there's a bug
sbussard on HN
The term serverless is misleading
From 2 comments
"serverless" is really the misnomer of the year.
lucb1e on HNI hope this one won't stick. I never call it serverless because it doesn't make any sense to me (I call it "shared hosting", the term everyone already knows). Then, by pointing…
lucb1e on HN
Requests
Cost estimate at some traffic level
From 1 comment
I'd be curious to see a cost estimate for some traffic level. I wonder if there's a way to put the pixel in s3 and process the access logs more cheaply.
cheriot on HN
Explain what Cube.js does in the pipeline
From 2 comments
Please explain what is cube.js doing in this? I mean, what exactly cubejs does.
InGodsName on HNWhy do you need to select all rows in your Cubejs section when you can directly run query in athena and get back the aggregates you need. Basically you select all rows then cubjs…
InGodsName on HN
Questions
Why use Cube.js when Athena can be queried directly
From 2 comments
Why do you need to select all rows in your Cubejs section when you can directly run query in athena and get back the aggregates you need. Basically you select all rows then cubjs…
InGodsName on HNHere is some more data: http://highscalability.com/blog/2018/4/2/how-ipdata-serves-25m-api-calls-from-10-infinitely-scalable.html I don't understand what's cubejs doing in this…
InGodsName on HN
Why not use S3 access logs or Fastly instead
From 2 comments
Is fastly free? Why would they use fastly and not s3?
InGodsName on HNI’ve seen folks put their pixel endpoint behind Fastly and process the access log delivered in S3. A Fastly VCL can handle the same transform that this Lambda is doing.
teej on HN
Alternatives named
Snowplow
From 1 comment
Side note: If you want to build your own mid-size event analytics data pipeline, then I recommend looking at snowplow: https://github.com/snowplow/snowplow
manigandham on HN
Google Analytics
From 1 comment
Genuine question. What does this do that just inserting vanilla GA code in the page doesn't? Trying to understand the "why".
tyingq on HN
BigQuery-based GA clone
From 2 comments
Interesting and nicely presented! I built a prototype of something very similar, but using Google BigQuery to store and extract data[0] but never took it beyond the concept…
gingerlime on HNInteresting. I once built a ga clone using appengine, cloud dataflow, and big query. I guess that would count as serverless? Benchmarked it against the official dumps to big quey…
jimktrains2 on HN