Download full web page

Black Cat

Hi guys, it's possible to download a full web page with the QtWebEngine (Python3)?

mpergand

@Black-Cat
First you have to register to downloadRequested(QWebEngineDownloadItem *download) signal emitted by the default profile.

Then in the slot method (sorry C++ code)

void downloadRequested(QWebEngineDownloadItem *download)
{
    if(download->isSavePageDownload())
        {
        download->setSavePageFormat(QWebEngineDownloadItem::CompleteHtmlSaveFormat);
        download->accept();
        }
}

This method is called on response to a right-click on "Save Page" in the context menu of the webview.

JKSH

@Black-Cat said in Download full web page:

Hi guys, it's possible to download a full web page with the QtWebEngine (Python3)?

Sure, Qt WebEngine's purposes is to let you download and view webpages.

If you meant "download to disk", call the toHtml() function (see https://doc.qt.io/qtforpython/PySide6/QtWebEngineCore/QWebEnginePage.html#PySide6.QtWebEngineCore.PySide6.QtWebEngineCore.QWebEnginePage.toHtml ) this will give you the web page as a HTML document, but you'll need to download the assets (such as images) separately.

Black Cat

@JKSH
But it's possible to create the same signal of the button "Save Page"? Because this method will link directly the images with the source (without download the images)?

JonB

@Black-Cat
If you look on @JKSH's page there is https://doc.qt.io/qtforpython/PySide6/QtWebEngineCore/QWebEnginePage.html#PySide6.QtWebEngineCore.PySide6.QtWebEngineCore.QWebEnginePage.save

This is a short cut for the following actions:

Trigger the Save web action.

Accept the next download item and set the specified file path and save format.

Black Cat

@JonB Can I use it with PyQT5? What I'm doing wrong?

        try:
            self.wvTest.page().save(
                # Working (output of indexed image)
                filepath, format=QWebEngineDownloadItem.MimeHtmlSaveFormat
                # Not working
                # filepath, format=QWebEngineDownloadRequest.MimeHtmlSaveFormat
            )

mpergand

@Black-Cat
First you have to register to downloadRequested(QWebEngineDownloadItem *download) signal emitted by the default profile.

Then in the slot method (sorry C++ code)

void downloadRequested(QWebEngineDownloadItem *download)
{
    if(download->isSavePageDownload())
        {
        download->setSavePageFormat(QWebEngineDownloadItem::CompleteHtmlSaveFormat);
        download->accept();
        }
}

This method is called on response to a right-click on "Save Page" in the context menu of the webview.

Black Cat

@mpergand Thank you man =)