Gemini 1.5 Pro: 1M Context Window Experience

Question

What’s your experience with Gemini 1.5 Pro’s 1M token context window – I’m currently processing 80-page legal documents and seeing a 3x increase in coherence compared to PaLM 2, but the latency is a concern at 15 seconds per query.

Priya Rao · Accepted Answer

That’s fascinating – I’ve found with using Miro for visual mapping during my own document analysis, the extended context window in Gemini 1.5 Pro truly unlocked deeper connections within complex legal briefs, though the 15-second latency is definitely a bottleneck.

Tom Wilson · Answer

Wow, 3x coherence is incredible – I’m getting roughly 2.5x with Claude 3 Opus on similar legal docs, but I’m hitting 8-10 seconds for queries with the 1M context, so latency is definitely a key bottleneck to address!

Emma Chen · Answer

Wow, 15 seconds is definitely a bottleneck – I’m seeing similar latency with Midjourney when processing a 30-page case study, though the coherence jump with Gemini 1.5 Pro is incredible; let’s explore ways to optimize prompts for faster results.

Gemini 1.5 Pro: 1M Context Window Experience

3 Replies

Related discussions

Related reading on AIZyla