Skip to main content
NETS Logo
Research

The NETS Lab ongoing projects are summarized below. Prospective research students are encouraged to reach out to Dr. White to discuss potential opportunities to get involved!

Autonomous Space Operations

The NETS Lab collaborates with astronautical engineers to develop guidance and navigation capabilities for autonomous space vehicles to support proximity operations with non-cooperative resident space objects, such as orbiting satellites and space debris.

Deep learning for computer vision and in-orbit satellite component detection to support in-orbit servicing and space debris-capture missions.

Cubesat

We have implemented state-of-the-art object detection algorithms to automatically classify and localize objects like solar panels, antennas, cubesats, and satellite bodies and run tests in Florida Tech's ORION Research Lab.

Orion Lab

Currently, we are tuning the models, developing best practices to deploy models on heavily limited computational resources characteristic of what can be implemented on small chaser satellites.

Learn more about a recent research presentation.

[Major parts of the efforts in this area have been supported by the U.S. Space Force and Air Force Research Lab.]

Novel Object Tracking Approach: To support the satellite project and beyond, we are developing novel object tracking algorithm that can run on edge hardware. 

3D Pose Estimation: Another group is working on computer vision-based estimation of the 6-DOF pose (position and orientation) of an object in three dimension based on a camera feed. See some initial work on spacecraft pose estimation.

To learn more about this work, see the following publications:

  • V. M. Nguyen, E. Sandidge, T. Mahendrakar, and R. T. White (2024). Characterizing Satellite Geometry via Accelerated 3D Gaussian Splatting. https://arxiv.org/abs/2401.02588 
  • M. N. Attzs, T. Mahendrakar, M. J. Meni, R. T. White, and I. Silver (2023). Comparison of Tracking-By-Detection Algorithms for Real-Time Satellite Component Tracking. 37th Annual Small Satellite Conference. https://digitalcommons.usu.edu/smallsat/2023/all2023/225/ 
  • T. Mahendrakar, R. T. White, M. Wilde, and M. Tiwari (2023). SpaceYOLO: A Human-Inspired Model for Real-time, On-board Spacecraft Feature Detection. 2023 IEEE Aerospace Conference (AERO). https://arxiv.org/abs/2302.00824
  • A. Ekblad, T. Mahendrakar, R. T. White, M. Wilde, I. Silver, and B. Wheeler (2023). Resource-constrained FPGA design for satellite component feature extraction. 2023 IEEE Aerospace Conference (AERO). https://arxiv.org/abs/2301.09055
  • T. Mahendrakar, M. N. Attzs, J. M. Duarte, A. L. Tisaranni, R. T. White, and M. Wilde (2023). Impact of intra-class variance on YOLOv5 model performance for autonomous navigation around non-cooperative targets. AIAA SCITECH 2023 Forum. https://arc.aiaa.org/doi/abs/10.2514/6.2023-2374
  • T. Mahendrakar, S. Holmberg, A. Ekblad, E. Conti, R. T. White, M. Wilde, and I. Silver (2023). Autonomous Rendezvous with Non-cooperative Target Objects with Swarm Chasers and Observers. AAS/AIAA Spaceflight Mechanics Conference 2023. https://arxiv.org/abs/2301.09059
  • B. Caruso, T. Mahendrakar, V. M. Nguyen, R. T. White, Todd Steffen (2023). 3D Reconstruction of Non-cooperative Resident Space Objects using Instant NGP-accelerated NeRF and D-NeRF. AAS/AIAA Spaceflight Mechanics Conference 2023. https://arxiv.org/abs/2301.09060
  • A. Ekblad, T. Mahendrakar, R. T. White, M. Wilde, I. Silver, and B. Wheeler (2023). Resource-constrained FPGA design for satellite component feature extraction. 2023 IEEE Aerospace Conference (AERO). https://arxiv.org/abs/2301.09055
  • T. Mahendrakar, A. Ekblad, N. Fischer, R. T. White, M. Wilde, B. Kish, and I. Silver (2022). Performance Study of YOLO V5 and Faster RCNN for Autonomous Navigation around Non-Cooperative Targets. 2022 IEEE Aerospace Conference (AERO). https://ieeexplore.ieee.org/abstract/document/9843537
  • T. Mahendrakar, J. Cutler, N. Fischer, A. Rivkin, A. Ekblad, K. Watkins, R. T. White, M. Wilde, B. Kish, and I. Silver (2021). Use of Artificial Intelligence for Feature Recognition and Flightpath Planning Around Non-Cooperative Resident Space Objects. AIAA ASCEND 2021. https://arc.aiaa.org/doi/abs/10.2514/6.2021-4123
  • T. Mahendrakar, R. T. White, M. Wilde, B. Kish, and I. Silver (2021). Real-time Satellite Component Recognition with YOLO-V5. 35th Annual Small Satellite Conference. https://digitalcommons.usu.edu/smallsat/2021/all2021/51/

Information Theoretic Analysis of Neural Networks and Explainable AI

We are studying how information flows through neural networks to devise novel loss functions, architectures, and training schemes to support computational efficiency as well as probabilistic analysis of internal data representations for explainable AI. Much of this work is funded by the U.S. Army Research and Development Center.

  • M. J. Meni, T. Mahendrakar, O. D. Raney, R. T. White, M. L. Mayo, and K. R. Pilkiewicz (2024). Taking a PEEK into YOLOv5 for Satellite Component Recognition via Entropy-based Visual Explanations. AIAA SCITECH 2024 Forumhttps://arc.aiaa.org/doi/abs/10.2514/6.2024-2766 
  • M. J. Meni, R. T. White, M. L. Mayo, and K. R. Pilkiewicz (2023). Entropy-based Guidance of Deep Neural Networks for Accelerated Convergence and Improved Performance. https://arxiv.org/abs/2308.14938 

Natural Language Processing

The NETS lab is involved in an NLP project to support automation of requirements engineering in the aerospace domain. This is a collaboration with researchers at Georgia Tech.

  • A. Tikayat Ray, A. P. Bhat, R. T. White, V. M. Nguyen, O. J. Pinon Fischer, and D. N. Mavris (2023). Examining the Potential of Generative Language Models for Aviation Safety Analysis: Case Study and Insights Using the Aviation Safety Reporting System (ASRS). Aerospace 2023, 10, 770. https://doi.org/10.3390/aerospace10090770 

  • A. Tikayat Ray, B. F. Cole, O. J. Pinon Fischer, A. P. Bhat, R. T. White, and D. N. Mavris (2023). Agile Methodology for the Standardization of Engineering Requirements Using Large Language Models. Systems 2023, 11, 352. https://doi.org/10.3390/systems11070352 

  • A. Tikayat Ray, B. F. Cole, O. J. Pinon Fischer, R. T. White, and D. N. Mavris (2023). aeroBERT-Classifier: Classification of Aerospace Requirements using BERT. Aerospace 2023, 10, 279. https://doi.org/10.3390/aerospace10030279 
  • A. Tikayat Ray, O. J. Pinon-Fischer, D. N. Mavris, R. T. White, and B. F. Cole (2023). aeroBERT-NER: Named-entity recognition for aerospace requirements engineering using BERT. In AIAA SCITECH 2023 Forum. https://doi.org/10.2514/6.2023-2583

Additional Projects

Hemodynamics: The NETS Lab is collaborating with the Mulitscale Cardiovascular Fluids Laboratory to develop neural networks that learn to predict fluid flow patterns in aneurysms. This involves physics-informed neural networks (PINNs) that learn to produce results at a tiny fraction of the time of computational fluid dynamics (CFD) simulations.

Synthetic Electronic Health Records: A project aims to generate realistic synthetic health data to support researchers, protect privacy, ensure compliance, and accelerate medical analytics research.

Glaciology: The NETS Lab is developing an approach to track the evolution of glaciers over time using time-series satellite imagery. After testing on some manually gathered data, we developed a data pipeline to construct large datasets of images along with various variables associated with each glacier at each time. We are currently tuning neural image segmentation algorithms to automatically segment the glaciers in multispectral satellite imagery. See some recent developments by the team.

[Related work supported by the National Science Foundation in the SMAG REU Program]
[Current satellite data access provided by the European Space Agency]

Global Development: Dr. White serves as Senior Advisor on Data Sciences to non-profit organization Engage-AI on a research program to leverage machine learning and artificial intelligence to find best practices in pursuing development goals, such as the UNDP's Sustainable Development Goals (SDGs). The work involves developing an AI-enhanced data platform drawing from disparate data sources to facilitate data analysis, finding useful patterns in the relevant data with state-of-the-art machine learning methods, and working with governments and NGOs to shed light on pressing development issues.

The NETS Lab is open to supervising reasonable machine learning projects proposed by students under certain circumstances, especially those involving neural methods. Here are some examples.