I am new in python. I am getting two python list 'ad' and 'ttf' in the following code
code 1:
train_df = pd.read_csv('train.csv', dtype={'acoustic_data': np.int16, 'time_to_failure': np.float32})
ad = pd.DataFrame()
ttf = pd.Series()
failure_idxs = [5656574, 50085878, 104677356, 138772453, 187641820, 218652630,
245829585, 307838917, 338276287, 375377848, 419368880, 461811623,
495800225, 528777115, 585568144, 621985673]
for idx in failure_idxs:
ad = train_df['acoustic_data'].values[idx - 150000: idx + 30000]
ttf = train_df['time_to_failure'].values[idx - 150000: idx + 30000]
print("ad=",ad)
print("ttf=",ttf)
break
Output 1:
It prints out this
ad= [1 4 9 ... 8 6 5]
ttf= [ 0.03909828 0.03909828 0.03909827 ... 11.5332985 11.5332985
11.5332985 ]
Here is data generated by 'pd.read_csv' by using 'iterator' and 'chunksize'
Code 2:
train1 = pd.read_csv('train.csv', iterator=True, chunksize=150000, dtype={'acoustic_data': np.int16, 'time_to_failure': np.float64})
X_train = pd.DataFrame()
y_train = pd.Series()
for df in train1:
print("acoustic_data=",df['acoustic_data'])
print("time_to_failure=",pd.Series(df['time_to_failure'].values[-1]))
ch = gen_features(df['acoustic_data'])
break
Output 2: Data printed by 'pd.read_csv' by using 'iterator' and 'chunksize' is like this
acoustic_data= 0 12
1 6
2 8
3 5
4 8
..
149995 1
149996 6
149997 6
149998 2
149999 0
Name: acoustic_data, Length: 150000, dtype: int16
time_to_failure= 0 1.469100
1 1.469100
2 1.469100
3 1.469100
4 1.469100
149995 1.430797
149996 1.430797
149997 1.430797
149998 1.430797
149999 1.430797
Name: time_to_failure, Length: 150000, dtype: float64
My function "ch = gen_features(df['acoustic_data'])" accepts input data generated by 'pd.read_csv' by using 'iterator' and 'chunksize'.How i can convert two simple python list 'ad' and 'ttf' into data generated by 'pd.read_csv' that use 'iterator' and 'chunksize'?
I simply mean how to programmatically convert
output 1 to just like
output 2 by using code 1?
ouput 2 has the index number with along with tab-separated values that are printed...while
output 1 is just the list of values ...How I can programmatically convert output 1 in the format of output 2?
You can download the sample code from
this link and run using python ide like spyder pychar etc .
What I have tried:
Python Lists | Python Education | Google Developers[
^]