TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: Database for analyzing US companies, visualize using Apache SuperSet

113 点作者 tessbi大约 2 年前
My main motivation was that I wanted to be able to drill down and filter across all the available stocks, look at the data for myself, and narrow down on the stocks I am interested based on my own sets of criteria, and make data-driven analysis for my personal investment strategies.<p>I used PostgreSQL as the backend database for ELT data pipelines, and used Citus Data cstore_fdw for columnar compression for the final dataset. All financial data is coming from SEC Edgar, <a href="https:&#x2F;&#x2F;www.sec.gov&#x2F;developer" rel="nofollow">https:&#x2F;&#x2F;www.sec.gov&#x2F;developer</a>. I used Python for downloading most of the data.<p>I also run the data load development locally on my home Ubuntu server that I built 5 years ago. I bought 4TB of M2 disks for best database performance, with PRIME B360M-A motherboard and Intel Chip Coffee Lake S.<p>I built the website simply using WordPress, and I run Apache Superset using gunicorn via Apache Webserver reverse proxy.<p>The registration form I had to build myself with PHP and some JavaScript, because it needed to automatically create a SuperSet user upon registration. Otherwise, I would need to input everyone manually. I used Python again for the data integration.<p>Please don&#x27;t use the database directly as an investment tool, as its in Beta, and the data still needs to undergo heavy data quality checks, please confirm all the numbers yourself, as I provide a link for every company to the SEC filings.

15 条评论

dventimihasura大约 2 年前
It&#x27;s unusual to require or even ask for personal information joining name, email, and phone number to register, especially for a free site from an untrusted source. There&#x27;s no way I&#x27;m putting my information in there.
评论 #35630220 未加载
btzs大约 2 年前
Interesting! Whenever I am in a more active investing phase I feel like I don&#x27;t have the data available I would like to have for making decisions.<p>I am getting &#x27;Database error: Unknown error&#x27; when trying to run a query. Maybe too much load at the moment.<p>Regarding the sign-up form: You expect the input to follow the format &#x27;888 888 8888&#x27; including blanks. I would consider dropping the phone number altogether or at least allow other formats.
评论 #35630242 未加载
koromak大约 2 年前
Account creation failed because I chose a user name that already existed.<p>When I changed the username, account creation failed because my email and phone were already taken. I guarantee they aren&#x27;t, I think the system actually registered me the first time and I&#x27;m now totally locked out from using that email.
评论 #35630233 未加载
hanniabu大约 2 年前
I have no use for this but I&#x27;ve gotta say this is pretty awesome, great job!
评论 #35624243 未加载
tessbi大约 2 年前
For most questions, please look through the tutorial videos and documentation that I created! :)<p><a href="https:&#x2F;&#x2F;tesseractanalytics.ai&#x2F;data-tutorials&#x2F;" rel="nofollow">https:&#x2F;&#x2F;tesseractanalytics.ai&#x2F;data-tutorials&#x2F;</a><p><a href="https:&#x2F;&#x2F;tesseractanalytics.ai&#x2F;finance-data-quarterly-data-documentation&#x2F;" rel="nofollow">https:&#x2F;&#x2F;tesseractanalytics.ai&#x2F;finance-data-quarterly-data-do...</a>
_siis大约 2 年前
This seems like your going down the rabbit hole into an area where only the bigs can compete, its also a fools errand in my opinion.<p>There&#x27;s a growing sentiment that the stock market is rigged, and I&#x27;ve seen several instances where that almost certainly seems to be the case and no action has been taken. It started with the COMEX eligible silver and gold holdings which have never been independently audited.<p>Then GME and FRC more recently.<p>Once you realize the mechanisms that allowed those to be successful, you realize they can do it with any publicly traded company, and its no longer an investment because the fundamentals have nothing to do with it. You can cause companies to fail simply by causing aggregated indebtness violations. Synthetic shares can be created indirectly which let you create more selling or buying than exist in the float. There&#x27;s only one way the the basic mechanics say happens when that exists.<p>Its a casino, no longer a real investment and any company with better funding alternatives won&#x27;t go public if they intend to stay in the business for longer than a few years. Most of the companies are zombie companies which are overvalued. Some are undervalued. Its not a good business to be in, there&#x27;s some real evil schmucks playing games with information that isn&#x27;t public.
snapcaster大约 2 年前
This is cool! Signed up, your phone number part of UI seems unnecessary to even collect and the UI is bad
评论 #35630245 未加载
arco1991大约 2 年前
This is very cool! Would be amazing if you could pass in data in a certain format (like the SEC data) from non-US companies as well and view&#x2F;compare data in the same way.
评论 #35634699 未加载
muffles大约 2 年前
How often is the database updated? For instance on stock price data can it be considered realtime (or 15 min lag) for daily market tracking? Not familiar with that SEC api.
评论 #35623619 未加载
sdfghswe大约 2 年前
Is it just me or this website is completely broken on the desktop?<p>EDIT: hold off on that, might be my company intruding on my connection.
rr808大约 2 年前
I looked at superset a few years ago and looked great but not popular enough to trust it. Seems the same state now?
评论 #35625631 未加载
评论 #35624081 未加载
评论 #35626332 未加载
las2k大约 2 年前
Where do you get daily stock prices data from?
LunaSea大约 2 年前
At a first Glance, SuperSet seems a bit limited compared to Grafana.
评论 #35626772 未加载
评论 #35630270 未加载
roflyear大约 2 年前
How can I log into the portal?
评论 #35623596 未加载
comp1927大约 2 年前
nice work, how big is the dataset? @tessbi
评论 #35631479 未加载