I usually use csvkit (<a href="https://csvkit.readthedocs.io/en/1.0.1/index.html" rel="nofollow">https://csvkit.readthedocs.io/en/1.0.1/index.html</a>). There are commands to list the columns, filter, browse the data in a somewhat formatted way with less. Typing the commands is a huge pain though, and I would be very interested in a tool that could <i>instantly</i> pop open and let me peruse. Excel can take minutes to load and eagerly does a lot of unhelpful formatting on things like dates and decimals.<p>That being said I would never want to (and often legally cannot) etl my data to some third party. That would be terribly slow. But I would happily pay for a nice desktop tool to do it for me; command line or GUI.
Hi HN!<p>A few months ago, a college friend reached out because his consulting company had just received a 60 Gb spreadsheet, and they didn't know what to do with it! They actually tried opening it in Excel.<p>I'm excited to Show HN CSV Explorer - a simple web tool for opening really big CSVs! Try it out, and let me know how it goes!
This is really awesome. What sparked this idea?<p>Not sure if you have this feature, but I think it would be really cool if you could open APIs to your own datasets. This could be really useful for enterprise applications that do a lot of flat file imports/exports to push/pull data.
This tool would be great were it not for me (rightfully) getting fired and possibly sued by any of my clients if I uploaded even a single file. In fact, what kind of business with millions-of-rows kind of files would entrust said datasets to a service that to me seems strangely vague [1] on how the data is secured, or where it is actually going to be physically stored.<p>[1] <a href="https://www.csvexplorer.com/legal/privacy/" rel="nofollow">https://www.csvexplorer.com/legal/privacy/</a>
My solution to this problem, so far, has been ipython and pandas. (and maybe jupyter notebook for visualization and sharing).<p>What's the value-add here?