Compare commits
44
Commits
2ccb432968
...
master
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
0a87b5f691 | ||
|
|
9d61c268e1 | ||
|
|
447f55461b | ||
|
|
d2e3c956d3 | ||
|
|
ebafe27304 | ||
|
|
5fcdf5b855 | ||
|
|
8d6bf4749e | ||
|
|
9f02cc620f | ||
|
|
801e3fe9f8 | ||
|
|
522478572f | ||
|
|
a2a3011f6b | ||
|
|
1a50f7e6de | ||
|
|
86404adc46 | ||
|
|
0f0ee40e70 | ||
|
|
b16963d18c | ||
|
|
300c5acd0e | ||
|
|
393f8a2644 | ||
|
|
84a2bbd8c4 | ||
|
|
09e1b8e6bb | ||
|
|
20278bd27c | ||
|
|
fb9eb38eaa | ||
|
|
1ae7563117 | ||
|
|
8971600016 | ||
|
|
13cdd81787 | ||
|
|
98f33f552e | ||
|
|
ae540c5517 | ||
|
|
8ba4942759 | ||
|
|
4f2350bd15 | ||
|
|
8752b99484 | ||
|
|
a48b8c43da | ||
|
|
1a148971e9 | ||
|
|
0f13ce8e3a | ||
|
|
55977273dd | ||
|
|
bd0d38a937 | ||
|
|
9538242061 | ||
|
|
81a0649a36 | ||
|
|
84a64cd8cd | ||
|
|
3788d5012b | ||
|
|
2a28b9b431 | ||
|
|
06d7511b9b | ||
|
|
8c634a20ab | ||
|
|
572d1edb70 | ||
|
|
b939ffcf7f | ||
|
|
dd6a2252e4 |
@@ -0,0 +1,25 @@
|
||||
## Benchmark Fastest Timeseries alternatives: ClickHouse Vs. InfluxDB Vs. Postgresql Vs. Parquet Vs. MongoDB Vs. DuckDB Vs Kdb+
|
||||
|
||||
-----
|
||||
|
||||
#### How to use:
|
||||
* Run:
|
||||
```
|
||||
mkdir data
|
||||
pip install requirements.txt
|
||||
```
|
||||
* Rename the file "properties-model.ini" to "properties.ini"
|
||||
* Fill with your own credentials
|
||||
|
||||
|
||||
----
|
||||
|
||||
The proposal of this work is to compare the speed in read/writing a specific amount of data, in this case, a dataset with 9 columns and 1.000.000 lines) calculating medium ingestion time betwenn seven diferent databases:
|
||||
* ClickHouse
|
||||
* InfluxDB
|
||||
* Postgresql
|
||||
* Parquet (in a S3 Minio Storage)<br>
|
||||
* DuckDB
|
||||
* MongoDB
|
||||
* Kdb+
|
||||
|
||||
+2460
File diff suppressed because one or more lines are too long
@@ -0,0 +1,24 @@
|
||||
[CLICKHOUSE]
|
||||
user = your_user_or_email
|
||||
key = your_key_or_password
|
||||
url = url_of_the_server
|
||||
|
||||
[INFLUXDB]
|
||||
user = your_user_or_email
|
||||
key = your_key_or_password
|
||||
url = url_of_the_server
|
||||
|
||||
[POSTGRESQL]
|
||||
user = your_user_or_email
|
||||
key = your_key_or_password
|
||||
url = url_of_the_server
|
||||
|
||||
[S3MINIO]
|
||||
user = your_user_or_email
|
||||
key = your_key_or_password
|
||||
url = url_of_the_server
|
||||
|
||||
[MONGODB]
|
||||
user = your_user_or_email
|
||||
key = your_key_or_password
|
||||
url = url_of_the_server
|
||||
@@ -0,0 +1,15 @@
|
||||
clickhouse_driver==0.2.6
|
||||
duckdb==0.8.0
|
||||
influxdb_client==1.36.1
|
||||
matplotlib==3.7.1
|
||||
minio==7.1.14
|
||||
numpy==1.23.1
|
||||
pandas==1.5.3
|
||||
pdmongo==0.3.4
|
||||
pymongo==4.3.3
|
||||
python-dotenv==1.0.0
|
||||
pytz==2022.7
|
||||
pytz==2023.3
|
||||
qbstyles==0.1.4
|
||||
qPython==2.0.0
|
||||
SQLAlchemy==1.4.48
|
||||
Reference in New Issue
Block a user