bimil's comments

Select Star | Remote (US, Canada, Europe) | Full-time | https://selectstar.com/about-us

Select Star is a data discovery platform that automatically catalogs & documents database tables and BI dashboards. You can find out where your data is coming from, which dashboards are built on top of it, who is using the data, and how they are using it.

Our stack includes React, Typescript, Python, Django, and Rust.

We're a well-funded seed-stage startup growing fast and we're hiring across the board: Engineering Manager, Sr. Front-end Engineer, Data Platform Lead, Sales Engineer, Analytics Engineer, DevOps Engineer... If you're looking for interesting challenges in data, and a place where you can make an impact - you should talk to us!

Select Star | Remote (US, Canada, Europe) | Full-time | https://selectstar.com/about-us

Select Star is a data discovery platform that automatically catalogs & documents database tables and BI dashboards. You can find out where your data is coming from, which dashboards are built on top of it, who is using the data, and how they are using it.

Our stack includes React, Typescript, Python, Django, and Rust.

We're a well-funded seed-stage startup growing fast and we're hiring across the board: Engineering Manager, Sr. Front-end Engineer, Product Manager, Sales Engineer, Analytics Engineer, DevOps Engineer, and Growth Manager. Check out https://selectstar.com/about-us

Congrats on the launch! Data Quality is an important area that our customers always ask about on Select Star (https://selectstar.com). Looking forward to integrate with you guys one day.

Thanks! Currently we support all major cloud data warehouses and BI tools including Snowflake, BigQuery, Redshift, Tableau, Mode, Looker, and dbt.

Hello HN!

I’m Shinji, founder of Select Star. Starting today, we’re opening Select Star as a GA product with a Free tier.

HN is special to me & Select Star because I met one of my founding engineers from the HN Seeking freelancer post. He’s now built our Rust SQL parser from the ground up.

Select Star was born from my love of working with data. Over the last 13 years, I’ve worked as a software engineer, data scientist, business analyst, product manager, and a data startup founder, working with structured and unstructured data across a variety of use cases.

While having lots of data is great, I believe that to use it effectively you also need to understand the context around it. And building and maintaining that context is hard if you were to build a data dictionary manually.

Select Star is designed to bring you and everyone on your team the full context of data in your organization. Select Star will tell you where the data came from, who’s using it, how they’re using it and what reports/dashboards are already created based on the data.

And it does it automatically within the first hours of you connecting your data warehouse and/or BI tools.

See Select Star in action: https://youtu.be/eZuIyq4DP1o

Feel free to ask me anything!

Select Star | Sr. Front-end Engineer, Data Platform Lead Engineer, Sales Engineer | Remote (US, Canada, and Europe) | Full-time | https://jobs.selectstar.com

Select Star is a data discovery platform that automatically analyzes & documents your data. Many data scientists and business analysts spend too much time looking for the right data, often having to ask other people to find it. Select Star provides an easy to use data portal that everyone can use to find and understand data.

We’re looking for experienced engineers to join our early team. We’re a small, well-funded, fully remote team working closely with our initial customers. Our stack includes React, Typescript, Python, Django, and Rust.

We have multiple engineering & non-engineering positions open. Read more & apply directly: https://jobs.selectstar.com/

Select Star | Dir. of Engineering, Sr. Engineer (Front-end & Back-end), Customer Engineer, Chief of Staff | Remote (US, Canada, and Europe) | Full-time or Contract to Full-time | https://jobs.selectstar.com

Select Star is a data discovery platform that automatically analyzes & documents your data. Many data scientists and business analysts spend too much time looking for the right data, often having to ask other people to find it. Select Star provides an easy to use data portal that everyone can use to find and understand data.

We're looking for experienced engineers to join our early team. We're a small, well-funded, fully remote team working closely with our initial customers. Our stack includes React, Typescript, Python, Django, and Rust.

We have multiple positions open and looking to grow fast. Read more & apply here: https://jobs.selectstar.com/

Select Star | Sr. Engineers (Front-end & Back-end), Data Relations | Remote (US, Canada, and Europe) | Full-time | https://selectstar.com

Select Star is a data discovery platform that automatically analyzes & documents your data. Many data scientists and business analysts spend too much time looking for the right data, often having to ask other people to find it. Select Star provides an easy to use data portal that everyone can use to find and understand data.

We're looking for experienced engineers to join our early team. We're a small, well-funded, fully remote team working closely with our initial customers. Our stack includes React, Typescript, Python, Django, and Rust.

We have multiple engineering & non-engineering positions open. Read more & apply here: https://jobs.selectstar.com/

Stealth Data Startup | Founding Engineer | Remote | Full-time

We are a VC backed seed-stage startup, building an internal data management solution. Looking for a senior engineer to take on the role of Tech Lead / Founding Engineer to help build our v1 product and bring us to market.

The right candidate will be a full stack engineer, with a product mindset, and ideally have worked as a tech lead or engineering manager of a small team. Previous experience at a data infrastructure, data science companies or data platform teams is a big plus.

The correct candidate should feel passionate about attacking a large, high stakes market, and being an engineering & product leader. If that sounds exciting to you, please reach out to bimilplus [at] gmail.com

Yeah I guess that's one way to put it (little different but kindof).

many differences from spark/storm/flink, but the most notable difference of concord is its dynamic topology model - deployment, scaling, and changes to your topologies all can be done in runtime, w/o restart of the full topology, which is required for spark/storm/flink.

Here's some benchmark:

Word count of 1.13B messages - Storm: ~16K QPS/node, 100ms per event (P999) - Spark Streaming: 100K QPS/node, 1s batch window - Concord: 500K QPS/node, 10ms per event (P999)

Server log processing (29G server log, ~260M msgs) 7 different computations including deduplication, counting, pattern matching, windowing... 4 nodes, 8 vCPU, 32GB RAM each Concord: 1M – 1.8M QPS / cluster Spark Streaming: 72K – 2M QPS / cluster

Concord generally performed in the consistent range of 1-1.8M QPS for whereas Spark's throughput varied differently based on window sliding / amount of internal shared state.

One of the cofounders here. We're in C++ - no 15-20% cost on JVM. Plus we've made a lot of optimizations on our communication and networking including libevent.

I like how I can use it from my iphone safari. What mobile framework did you use (if any) to make this? / especially the upload image part?

Congrats to Instagram. I think the real value that's been overlooked for Instagram is the Instagram community. Instagram has a very strong community around the world (www.instagramers.com has more than 250 chapter groups) and that may be one of the factors Facebook was looking at.