Compare commits
44
Commits
2ccb432968
...
master
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
0a87b5f691 | ||
|
|
9d61c268e1 | ||
|
|
447f55461b | ||
|
|
d2e3c956d3 | ||
|
|
ebafe27304 | ||
|
|
5fcdf5b855 | ||
|
|
8d6bf4749e | ||
|
|
9f02cc620f | ||
|
|
801e3fe9f8 | ||
|
|
522478572f | ||
|
|
a2a3011f6b | ||
|
|
1a50f7e6de | ||
|
|
86404adc46 | ||
|
|
0f0ee40e70 | ||
|
|
b16963d18c | ||
|
|
300c5acd0e | ||
|
|
393f8a2644 | ||
|
|
84a2bbd8c4 | ||
|
|
09e1b8e6bb | ||
|
|
20278bd27c | ||
|
|
fb9eb38eaa | ||
|
|
1ae7563117 | ||
|
|
8971600016 | ||
|
|
13cdd81787 | ||
|
|
98f33f552e | ||
|
|
ae540c5517 | ||
|
|
8ba4942759 | ||
|
|
4f2350bd15 | ||
|
|
8752b99484 | ||
|
|
a48b8c43da | ||
|
|
1a148971e9 | ||
|
|
0f13ce8e3a | ||
|
|
55977273dd | ||
|
|
bd0d38a937 | ||
|
|
9538242061 | ||
|
|
81a0649a36 | ||
|
|
84a64cd8cd | ||
|
|
3788d5012b | ||
|
|
2a28b9b431 | ||
|
|
06d7511b9b | ||
|
|
8c634a20ab | ||
|
|
572d1edb70 | ||
|
|
b939ffcf7f | ||
|
|
dd6a2252e4 |
@@ -0,0 +1,25 @@
|
|||||||
|
## Benchmark Fastest Timeseries alternatives: ClickHouse Vs. InfluxDB Vs. Postgresql Vs. Parquet Vs. MongoDB Vs. DuckDB Vs Kdb+
|
||||||
|
|
||||||
|
-----
|
||||||
|
|
||||||
|
#### How to use:
|
||||||
|
* Run:
|
||||||
|
```
|
||||||
|
mkdir data
|
||||||
|
pip install requirements.txt
|
||||||
|
```
|
||||||
|
* Rename the file "properties-model.ini" to "properties.ini"
|
||||||
|
* Fill with your own credentials
|
||||||
|
|
||||||
|
|
||||||
|
----
|
||||||
|
|
||||||
|
The proposal of this work is to compare the speed in read/writing a specific amount of data, in this case, a dataset with 9 columns and 1.000.000 lines) calculating medium ingestion time betwenn seven diferent databases:
|
||||||
|
* ClickHouse
|
||||||
|
* InfluxDB
|
||||||
|
* Postgresql
|
||||||
|
* Parquet (in a S3 Minio Storage)<br>
|
||||||
|
* DuckDB
|
||||||
|
* MongoDB
|
||||||
|
* Kdb+
|
||||||
|
|
||||||
+2460
File diff suppressed because one or more lines are too long
@@ -0,0 +1,24 @@
|
|||||||
|
[CLICKHOUSE]
|
||||||
|
user = your_user_or_email
|
||||||
|
key = your_key_or_password
|
||||||
|
url = url_of_the_server
|
||||||
|
|
||||||
|
[INFLUXDB]
|
||||||
|
user = your_user_or_email
|
||||||
|
key = your_key_or_password
|
||||||
|
url = url_of_the_server
|
||||||
|
|
||||||
|
[POSTGRESQL]
|
||||||
|
user = your_user_or_email
|
||||||
|
key = your_key_or_password
|
||||||
|
url = url_of_the_server
|
||||||
|
|
||||||
|
[S3MINIO]
|
||||||
|
user = your_user_or_email
|
||||||
|
key = your_key_or_password
|
||||||
|
url = url_of_the_server
|
||||||
|
|
||||||
|
[MONGODB]
|
||||||
|
user = your_user_or_email
|
||||||
|
key = your_key_or_password
|
||||||
|
url = url_of_the_server
|
||||||
@@ -0,0 +1,15 @@
|
|||||||
|
clickhouse_driver==0.2.6
|
||||||
|
duckdb==0.8.0
|
||||||
|
influxdb_client==1.36.1
|
||||||
|
matplotlib==3.7.1
|
||||||
|
minio==7.1.14
|
||||||
|
numpy==1.23.1
|
||||||
|
pandas==1.5.3
|
||||||
|
pdmongo==0.3.4
|
||||||
|
pymongo==4.3.3
|
||||||
|
python-dotenv==1.0.0
|
||||||
|
pytz==2022.7
|
||||||
|
pytz==2023.3
|
||||||
|
qbstyles==0.1.4
|
||||||
|
qPython==2.0.0
|
||||||
|
SQLAlchemy==1.4.48
|
||||||
Reference in New Issue
Block a user