Context
NIghtly builds have been passing recently. LlamaInded failed overnight with a problem we have encountered before. We would get a response back, but it would not contain the number of documents that we requested.
Failing build: https://spruce.mongodb.com/version/6621b07d2e272f0007c8a352/tasks?sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC
Definition of done
For now, we update the llama-index code (which has not yet been merged upstream) to continue requesting until we get the number we expect.
Pitfalls
The solution - to continue requesting until we get the number we expect - does NOT leading to a GOOD USER EXPERIENCE.