d2jsp
Log InRegister
d2jsp Forums > Off-Topic > Computers & IT > Programming & Development > Programming Cpp Python
Add Reply New Topic New Poll
Member
Posts: 5,567
Joined: Apr 30 2006
Gold: 1,020.00
Sep 8 2016 08:44am
Hey.. i have a silly question.. i have a huge csv file that i read into memory using fread upfrontly allocating memory with malloc and then i store each column as a separate file .. after that i parallely invoke processes each calling a python script that reads two of the columns and calculates some statistics using group by from pandas.. while that is fairly ok, i am looking for improvement.. thus i am wondering - how could i skip the write column part and access malloced object directly from ram in python?
Member
Posts: 3,939
Joined: Feb 1 2013
Gold: 2,749.09
Warn: 20%
Sep 8 2016 09:44am
did u even read the python manual before posting this

for instance this https://docs.python.org/3/extending/embedding.html
Member
Posts: 36,123
Joined: Jul 18 2008
Gold: 2,407.00
Sep 14 2016 05:27am
Why even use the cpp part? Why not read the csv in Python?
Go Back To Programming & Development Topic List
Add Reply New Topic New Poll