How can I scrape a excel file from a website and divide it in different parts

Question

I have to develop a program that downloads an excel file from a website in manageable chunks. Each component can only be 10MB in size, and the file extension is (.xls).

I can write various pieces of a specific size, but the characters make them worthless. I tried changing the encoding, but that didn't help either.

A code sample:

with open(file, 'wb') as f:
        for part in requests.get(website_link, stream=True).iter_content(chunk_size=10000):
             f.write(chunk)
             actual_size += 10000
             if actual_size + 10000 >= maximum_chunk_size:
                break

Answer 1

Use Scrapy or beautifulsoup4 parsing data it's more convenient than requests.

You can check the file size in runtime like this:

import os

file_name = "/path/to/file"

file_stats = os.stat(file_name)
size_mb = file_stats.st_size / (1024 * 1024)  # in megabytes
size_kb = file_stats.st_size / 1024  # in kilobytes
size = file_stats.st_size  # bytes