selawdivad@lemm.eetoProgramming@beehaw.org•Is SQL a good language for data transformations?
1·
1 year agoCan I suggest duckdb?
You can start out writing SQL directly on top of CSV and Parquet files.
But then if you want/need to do something more complicated, you can import duckdb
into Python, keep running the SQL you already wrote, convert it to a Pandas or Polars dataframe, transform it, then query the result in SQL.
I used Zotero all through uni, but I’ve recently discovered JabRef. Zotero probably has more features and polish, but JabRef has one killer feature: Your plaintext BibLaTeX file is your reference database. So you can version control and collaborate on your reference file with git. No export required.