[Question]: RemoteReader not working while reading PDF data from URL

[qaixerabbas]

Question Validation

• I have searched both the documentation and discord for an answer.

Question

I am trying to read PDF data using RemoteReader from llama_hub but stuck into some JSONDecoreError. I am not sure what is causing the error here is my code below (copied directly from this link):

from llama_index import download_loader
RemoteReader = download_loader("RemoteReader")
url = "URL to a pdf"
loader = RemoteReader()
documents = loader.load_data(url=url)

Not sure it is a bug or some other issue but I am not able to run this code.

The code is throwing following error:

Traceback (most recent call last):
  File "D:\1. SDSol Projects\Between Sessions\AI Progress Notes Generator\worksheet analysis\experiments\another_test.py", line 3, in <module>
    RemoteReader = download_loader("RemoteReader")
  File "C:\Users\HP\AppData\Local\Programs\Python\Python39\lib\site-packages\llama_index\readers\download.py", line 133, in download_loader
    library = json.loads(library_raw_content)
  File "C:\Users\HP\AppData\Local\Programs\Python\Python39\lib\json\__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "C:\Users\HP\AppData\Local\Programs\Python\Python39\lib\json\decoder.py", line 340, in decode
    raise JSONDecodeError("Extra data", s, end)
json.decoder.JSONDecodeError: Extra data: line 1 column 4 (char 3)

[tyre]

Could you go into the llama_index package and print out the library_raw_content?

I've tried the code you linked with the URL https://writing.colostate.edu/guides/documents/resume/functionalsample.pdf and it works.

Alternatively, you can get this directly from the llamahub pip package (pip install llama-hub):

from llama_hub.remote.base import RemoteReader

url = "https://writing.colostate.edu/guides/documents/resume/functionalsample.pdf"
loader = RemoteReader()
documents = loader.load_data(url=url)
print(documents)

[dosubot[bot]]

Hi, @qaixerabbas! I'm Dosu, and I'm helping the LlamaIndex team manage their backlog. I wanted to let you know that we are marking this issue as stale.

From what I understand, you encountered a JSONDecodeError while trying to read PDF data using RemoteReader from the llama_hub package. User "tyre" suggested checking the library_raw_content in the llama_index package and provided an alternative code snippet to try.

Before we close this issue, we wanted to check if it is still relevant to the latest version of the LlamaIndex repository. If it is, please let us know by commenting on this issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days.

Thank you for your understanding!

[dosubot[bot]]

🤖

Hello,

Thank you for reaching out with your issue. Based on the error message you're seeing, it seems like there might be an issue with the JSON decoding process. This error typically occurs when the JSON decoder encounters data after it has finished decoding a valid JSON string.

However, I noticed that you're trying to read a PDF file using the RemoteReader from llama_hub. The RemoteReader is designed to read JSON files, not PDF files. This could be the reason why you're encountering a JSONDecodeError.

To resolve this issue, you would need to use a PDF reader instead of a JSON reader to read the data from your PDF files. If you need to use the RemoteReader class to process this data, you would first need to convert your PDF data into a JSON format that the RemoteReader class can process.

Additionally, I found a couple of similar issues in the LlamaIndex repository:

1. Issue #4449 suggests upgrading to the most recent version of LlamaIndex or installing the llama-hub pip package due to a change in the URL used by download_loader as llama-hub was made into a package.

2. Issue #6541 suggests updating to the new version of llama-index.

Lastly, please note that the use of download_loader is now deprecated and it is recommended to do pip install llama-hub instead.

I hope this helps! If you have any other questions, feel free to ask.

Best,
Dosu

Sources

• getting error raise JsonDecodeError("Extra data", s, end) with llama_index 0.6.9
• [Question]: Ingest Unstructured Data Through the Unstructured.io Reader
• llama_index/readers/json.py
• llama_index/readers/download.py

---

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.