Uploaded image for project: 'Python Driver'
  1. Python Driver
  2. PYTHON-4222

[langchain] Increase DEFAULT_INSERT_BATCH_SIZE to 100,000

XMLWordPrintableJSON

    • Type: Icon: Improvement Improvement
    • Resolution: Done
    • Priority: Icon: Unknown Unknown
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Python Drivers
    • Hide

      1. What would you like to communicate to the user about this feature?
      2. Would you like the user to see examples of the syntax and/or executable code and its output?
      3. Which versions of the driver/connector does this apply to?

      Show
      1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?
    • None
    • None
    • None
    • None
    • None
    • None

      Context

      We want to increase "DEFAULT_INSERT_BATCH_SIZE" in our LangChain vectorstore Implementation. This needs to be done after the partner package port lands.

      https://github.com/langchain-ai/langchain/pull/17652#discussion_r1496644090

      Additionally, we should run a performance test against the change to see if it improves performance.

      Definition of done

      DEFAULT_INSERT_BATCH_SIZE = 100_000

      Pitfalls

      None

            Assignee:
            jib.adegunloye@mongodb.com Jib Adegunloye
            Reporter:
            jib.adegunloye@mongodb.com Jib Adegunloye
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: