Personally, I use xsv and it’s been tremendously helpful, especially when working with larger files. https://github.com/BurntSushi/xsv
By giant I mean 25G gzipped files with >10^9 rows like these VCFs: https://ftp.ncbi.nlm.nih.gov/snp/latest_release/VCF/
sqlp: Run blazing-fast Polars SQL queries against several CSVs - converting queries to fast LazyFrame expressions, processing larger than memory CSV files.
to: Convert CSV files to PostgreSQL, SQLite, XLSX, Parquet and Data Package.
[1] https://github.com/jqnatividad/qsv/blob/master/src/cmd/sqlp....
[2] https://github.com/jqnatividad/qsv/blob/master/src/cmd/to.rs...
xsv is more lean while qsv tries to support every action that you might want to perform on CSV files.[2]
[1] https://github.com/jqnatividad/qsv
[2] https://github.com/jqnatividad/qsv/discussions/290#discussio...