Seek better query results

[bounaux]

Hi everyone, I'd like to pick your brain on a project I'm working on.

I have some files reporting diseases (i.e. a patient has some problems). A section of the file may say this patient has x,y,z problems, and this section can be pretty long. And another section may have just a coupel of sentenses. talking about a,b and c.

I'd like to have a query framework that is able to summarize the long section of x,y,z problems, and also able to itemize the short section a,b,c.

It seems when i set the chunk size to 1024, the long section summary is good, but query is not able to itemize the short section. When I reduce the chuck size to say 512, the short section summary looks good, but the long section summary only gives partial result (maybe missing c for example).

Is there a strategy you have used to combat this issue? Any suggestions to improve query results? Thx!