File tree Expand file tree Collapse file tree 1 file changed +14
-1
lines changed
Expand file tree Collapse file tree 1 file changed +14
-1
lines changed Original file line number Diff line number Diff line change 22
33## Overview
44
5- This codes how one can process data in parallel.
5+ This codes show how one can process data in parallel.
66It demonstrates how to read files in parallel and convert to Pandas and do some transformation before returning.
77
88It's demo code for below article:
99[ Parallel processing (Pandas example)] ( http://www.khalidmammadov.co.uk/parallel-processing-pandas-example )
1010
11+ ## Run it
12+
13+ For Sequential test
14+ ```
15+ import timeit
16+ timeit.timeit("pp.process_files_sequentially(Path('~/dev/test/exchange-rates/data/').expanduser())", "from parallel_pandas import parallel as pp; from pathlib import Path", number=1000)
17+ ```
18+
19+ For Parallel test
20+ ```
21+ import timeit
22+ timeit.timeit("pp.process_files_parallel(Path('~/dev/test/exchange-rates/data/').expanduser())", "from parallel_pandas import parallel as pp; from pathlib import Path", number=1000)
23+ ```
You can’t perform that action at this time.
0 commit comments