Foundation models, including Chat-GPT and its many variants, have come into prominence in the natural language processing (NLP) community thanks the ubiquity of text data readily available on the internet and the design of modern transformer architectures that can effectively learn from such data. However, popular DoD domains, such as autonomy and logistics, are faced with additional challenges not present in NLP and vision. In this talk, we discuss some of those challenges and opportunities for addressing them.
|