Sorbonne UniversitéSoftware Engineer/Developer
Dec. 2022 - Nov. 2023Contributing to an ESA initiative, I enhanced a cloud database with CALIOP/CALIPSO and ALADIN/Aeolus observations, focusing on advanced remote-sensing data analysis. This complex project demanded expertise in data preprocessing, machine learning, data visualization, statistical analysis, and optimization. Data Preprocessing: Led the extraction and processing from netCDF, HDF, and CSV files, ensuring data integrity. Advanced cleaning addressed missing values, setting high data quality standards.
Machine Learning & Interpolation: Developed a Random Forest Regressor using CALIPSO data for depolarization, countering the absence of cross-polar channel data in AEOLUS/ALADIN. I created 2D and 3D interpolation functions with ERA5 data, using IDW methods to enhance depolarization accuracy.
Statistical Analysis: Conducted detailed statistical analyses, calculating correlation coefficients, mean differences, and standard deviations to evaluate model performance, ensuring robust predictions.
Data Analysis Routines: Developed routines for estimating cloud amounts and constructing time series for cloud profiles, excluding SAA-affected regions for accuracy. A day/night mask generator was also developed to address satellite overpass time differences.
Advanced Data Visualization: Utilized a broad spectrum of visualization techniques to identify patterns and visualize atmospheric variables' intricate distribution, aiding in complex pattern revelation and effective findings communication.
Optimization & Efficiency: Applied parallel computing and vectorization for code optimization, enhancing processing efficiency across all routines.
Mentoring junior team members in software development underscored the collaborative success of this project, showcasing my ability to navigate geophysical data analysis complexities. This initiative reaffirmed my standing as a Python/IDL Developer, Data Scientist, and Physicist, advancing geophysical phenomenon understanding through innovative analysis.