ZThyddlZddlmZmZmZddlZddlmZddlm Z ddl m Z ddl m Z GddZGd d e Zy) N)AnyDictOptional) CsvConfig)CsvUploadService)DataImportService)TimeFormatTypecNeZdZUdZeeefed<dZe ed<d dZ dZ de fd Z y) BaseCh10Filea Base class for uploading IRIG Chapter 10/Chapter 11 files. Implement a concrete version of this class that parses a ch10 stream and returns a csv row of data on each iteration. Set `gzip` to `True` if sending a compressed stream. Example: ```python class Ch10(BaseCh10File): def __init__(self, path): self.file = open(path, "rb") self.initialize_csv_data_columns = None def initialize_csv_data_columns(self): self.csv_config_data_columns = self.process_ch10_computer_f1_packet() def process_ch10_computer_f1_packet(self) -> Dict[int, dict]: # Processes the first Computer F1 packet # and returns the measurements as a dict. ... def process_ch10_pcm_packet(self) -> str: # Processed the data packets and returns # a CSV row. ... def __next__(self) -> str: # On all iterations, return data for the CSV file. if end_of_file: raise StopIteration() else: return self.process_ch10_data_packet() ``` csv_config_data_columnsFgzipreturnNct)z Must populate the `csv_config_data_columns` attribute that is the data_columns entry in the CsvConfig. See the Sift data_import module or API docs for the schema. NotImplementedErrorselfs ]/home/www/backend.miabetepe.com/venv/lib/python3.12/site-packages/sift_py/data_import/ch10.pyinitialize_csv_data_columnsz(BaseCh10File.initialize_csv_data_columns7s "!c|SNrs r__iter__zBaseCh10File.__iter__@s rctrrrs r__next__zBaseCh10File.__next__Cs!!r)rN)__name__ __module__ __qualname____doc__rintdict__annotations__r boolrrstrrrrrr r s8%N"#t)_,D$""#"rr c XeZdZdZej ddfdedededeedeede f d Z y) Ch10UploadServicezService to upload ch10 files.N ch10_file asset_name time_formatrun_namerun_idrc |jt|dsJd|d|dd|jd}|r||d<|r||d<t|}t j |j d |jd d tjd |ji }|jdk7r%td|jd|j |j} | d} | d} dd |ji} |j"rd| d<t j | | | }|jdk7r%td|jd|jt%|j&| S#tjjt f$r } td|jd| d} ~ wwxYw#t $r} td| dd} ~ wwxYw)ay Uploads the ch10 file to the specified asset. Override `time_format` to specify the time data format. Default is `TimeFormatType.ABSOLUTE_UNIX_NANOSECONDS`. Override `run_name` to specify the name of the run to create for this data. Default is None. Override `run_id` to specify the id of the run to add this data to. Default is None. r zF`csv_config_data_columns` was not set correctly on the first iteration)format column_number)r)first_data_row time_column data_columnsr+r,zBearer zapplication/octet-stream) AuthorizationContent-Encoding csv_config)urlheadersdataz3Config file upload request failed with status code z. zInvalid response: z. N uploadUrl dataImportIdz Response missing required keys: zI. This is unexpected. Please reach out to the Sift team about this error.r5r r6z1Data file upload request failed with status code )rgetattrr rrequestspost _upload_uri_apikeyjsondumpsto_dict status_code ExceptiontextdecoderJSONDecodeErrorKeyErrorr r _rest_conf)rr(r)r*r+r, config_infor7response upload_infoe upload_urldata_import_idr9s ruploadzCh10UploadService.uploadJs% --/y";< T < %%!"&=='  &.K # $,K !{+ ==  #*4<<.!9$>\:+=+=+?@A     3 &EhFZFZE[[]^f^k^k]lm  H"--/K )+6J"-n"=N wt||n5  >>*0G& '==    3 &CHDXDXCYY[\d\i\i[jk !.AA; ,,h7 H0s1#FG G H  21#5~  s0E:, G:#F=F88F= G GG) rrrr r ABSOLUTE_UNIX_NANOSECONDSr r%rrrSrrrr'r'Gsk' '5&N&N"& $ SBSBSB$ SB 3- SB  SB SBrr')rCtypingrrrr?sift_py.data_import.configrsift_py.data_import.csvrsift_py.data_import.statusrsift_py.data_import.time_formatr r r'rrrrZs9 &&048:8"8"vVB(VBr