我在您的代码块中没有看到任何主要缺点。但是这里有一些通过这个解决方案和这个自动化测试脚本的执行的建议：

1. 此代码在非市场时间完美运行。在市场时间，很多JavaScript&Ajax Calls正在发挥作用，处理这些超出了本问题的范围。
2. 您可以考虑首先检查预期的下载目录，如果不可用，请创建一个新目录。此功能的代码块采用 Windows 风格，在 Windows 平台上完美运行。
3. 单击“登录”后，会wait为 HTML DOM 正确呈现一些内容。
4. 当您想查看下载过程时，您需要FirefoxProfile在下面的代码中设置某些更多首选项。
5. 始终考虑通过最大化浏览器窗口 browser.maximize_window()
6. 当您开始下载时，您需要等待足够的时间来完全下载文件。
7. 如果您browser.quit()在最后使用，则不需要使用browser.close()
8. 您可以考虑time.sleep()用ImplicitlyWait或ExplicitWait或替换所有的FluentWait。

9. 这是您自己的代码块，其中有一些简单的调整：

   #!/usr/bin/python
   print "hello from python 2"
   
   import urllib2
   from selenium import webdriver
   from selenium.webdriver.common.keys import Keys
   import time
   from pyvirtualdisplay import Display
   import requests, zipfile, os    
   
   display = Display(visible=0, size=(800, 600))
   display.start()
   
   newpath = 'C:\\home\\vivvin\\shKLSE'
   if not os.path.exists(newpath):
       os.makedirs(newpath)    
   
   profile = webdriver.FirefoxProfile()
   profile.set_preference("browser.download.dir",newpath);
   profile.set_preference("browser.download.folderList",2);
   profile.set_preference("browser.helperApps.neverAsk.saveToDisk", "application/zip");
   profile.set_preference("browser.download.manager.showWhenStarting",False);
   profile.set_preference("browser.helperApps.neverAsk.openFile","application/zip");
   profile.set_preference("browser.helperApps.alwaysAsk.force", False);
   profile.set_preference("browser.download.manager.useWindow", False);
   profile.set_preference("browser.download.manager.focusWhenStarting", False);
   profile.set_preference("browser.helperApps.neverAsk.openFile", "");
   profile.set_preference("browser.download.manager.alertOnEXEOpen", False);
   profile.set_preference("browser.download.manager.showAlertOnComplete", False);
   profile.set_preference("browser.download.manager.closeWhenDone", True);
   profile.set_preference("pdfjs.disabled", True);
   
   for retry in range(5):
       try:
           browser = webdriver.Firefox(profile)
           print "firefox"
           break
       except:
           time.sleep(3)
   time.sleep(1)
   
   browser.maximize_window()
   browser.get("https://www.shareinvestor.com/my")
   time.sleep(10)
   login_main = browser.find_element_by_xpath("//*[@href='/user/login.html']").click()
   time.sleep(10)
   print browser.current_url
   username = browser.find_element_by_id("sic_login_header_username")
   password = browser.find_element_by_id("sic_login_header_password")
   print "find id done"
   username.send_keys("bkcollection")
   password.send_keys("123456")
   print "log in done"
   login_attempt = browser.find_element_by_xpath("//*[@type='submit']")
   login_attempt.submit()
   browser.get("https://www.shareinvestor.com/prices/price_download.html#/?type=price_download_all_stocks_bursa")
   print browser.current_url
   time.sleep(20)
   dl = browser.find_element_by_xpath("//*[@href='/prices/price_download_zip_file.zip?type=history_all&market=bursa']").click()
   time.sleep(900)
   
   browser.close()
   browser.quit()
   display.stop()
   
   zip_ref = zipfile.ZipFile(/home/vinvin/sh/KLSE, 'r')
   zip_ref.extractall(/home/vinvin/sh/KLSE)
   zip_ref.close()
   os.remove(zip_ref)
   

如果这能回答您的问题，请告诉我。

我重新编写了您的脚本，并附有注释，解释了我进行更改的原因。我认为您的主要问题可能是一个糟糕的模仿类型，但是，您的脚本有一个系统问题的日志，这最多会使它变得不可靠。此重写使用显式等待，这完全消除了使用的需要time.sleep()，允许它尽可能快地运行，同时还消除了由于网络拥塞引起的错误。

您需要执行以下操作以确保安装了所有module：

pip install requests explicit selenium retry pyvirtualdisplay

剧本：

#!/usr/bin/python

from __future__ import print_function  # Makes your code portable

import os
import glob
import zipfile
from contextlib import contextmanager

import requests
from retry import retry
from explicit import waiter, XPATH, ID
from selenium import webdriver
from pyvirtualdisplay import Display
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.support.wait import WebDriverWait

DOWNLOAD_DIR = "/tmp/shKLSE/"


def build_profile():
    profile = webdriver.FirefoxProfile()
    profile.set_preference('browser.download.folderList', 2)
    profile.set_preference('browser.download.manager.showWhenStarting', False)
    profile.set_preference('browser.download.dir', DOWNLOAD_DIR)
    # I think your `/zip` mime type was incorrect. This works for me
    profile.set_preference('browser.helperApps.neverAsk.saveToDisk',
                           'application/vnd.ms-excel,application/zip')

    return profile


# Retry is an elegant way to retry the browser creation
# Though you should narrow the scope to whatever the actual exception is you are
# retrying on
@retry(Exception, tries=5, delay=3)
@contextmanager  # This turns get_browser into a context manager
def get_browser():
    # Use a context manager with Display, so it will be closed even if an
    # exception is thrown
    profile = build_profile()
    with Display(visible=0, size=(800, 600)):
        browser = webdriver.Firefox(profile)
        print("firefox")
        try:
            yield browser
        finally:
            # Let a try/finally block manage closing the browser, even if an
            # exception is called
            browser.quit()


def main():
    print("hello from python 2")
    with get_browser() as browser:
        browser.get("https://www.shareinvestor.com/my")

        # Click the login button
        # waiter is a helper function that makes it easy to use explicit waits
        # with it you dont need to use time.sleep() calls at all
        login_xpath = '//*/div[@class="sic_logIn-bg"]/a'
        waiter.find_element(browser, login_xpath, XPATH).click()
        print(browser.current_url)

        # Log in
        username = "bkcollection"
        username_id = "sic_login_header_username"
        password = "123456"
        password_id = "sic_login_header_password"
        waiter.find_write(browser, username_id, username, by=ID)
        waiter.find_write(browser, password_id, password, by=ID, send_enter=True)

        # Wait for login process to finish by locating an element only found
        # after logging in, like the Logged In Nav
        nav_id = 'sic_loggedInNav'
        waiter.find_element(browser, nav_id, ID)

        print("log in done")

        # Load the target page
        target_url = ("https://www.shareinvestor.com/prices/price_download.html#/?"
                      "type=price_download_all_stocks_bursa")
        browser.get(target_url)
        print(browser.current_url)

        # CLick download button
        all_data_xpath = ("//*[@href='/prices/price_download_zip_file.zip?"
                          "type=history_all&market=bursa']")
        waiter.find_element(browser, all_data_xpath, XPATH).click()

        # This is a bit challenging: You need to wait until the download is complete
        # This file is 220 MB, it takes a while to complete. This method waits until
        # there is at least one file in the dir, then waits until there are no
        # filenames that end in `.part`
        # Note that is is problematic if there is already a file in the target dir. I
        # suggest looking into using the tempdir module to create a unique, temporary
        # directory for downloading every time you run your script
        print("Waiting for download to complete")
        at_least_1 = lambda x: len(x("{0}/*.zip*".format(DOWNLOAD_DIR))) > 0
        WebDriverWait(glob.glob, 300).until(at_least_1)

        no_parts = lambda x: len(x("{0}/*.part".format(DOWNLOAD_DIR))) == 0
        WebDriverWait(glob.glob, 300).until(no_parts)

        print("Download Done")

        # Now do whatever it is you need to do with the zip file
        # zip_ref = zipfile.ZipFile(DOWNLOAD_DIR, 'r')
        # zip_ref.extractall(DOWNLOAD_DIR)
        # zip_ref.close()
        # os.remove(zip_ref)

        print("Done!")


if __name__ == "__main__":
    main()

完全公开：我维护显式module。它旨在使使用显式等待变得更加容易，对于这种情况，网站根据用户交互缓慢加载动态内容。您可以waiter.XXX用直接显式等待替换上述所有调用。

把它拿出selenium的范围。更改首选项设置，以便在单击链接时（首先检查链接是否有效）它会弹出一个要求保存的弹出窗口，现在使用 sikuli http://www.sikuli.org/单击弹出窗口。Mime 类型并不总是有效，并且没有非黑即白的答案为什么它不起作用。

原因是网页加载缓慢。我在打开网页链接后添加了等待 20 秒

login_attempt.submit()
browser.get("https://www.shareinvestor.com/prices/price_download.html#/?type=price_download_all_stocks_bursa")
print browser.current_url
time.sleep(20)
dl = browser.find_element_by_xpath("//*[@href='/prices/price_download_zip_file.zip?type=history_all&market=bursa']").click()

它没有返回错误。

另外， /zip不正确的 MIME 类型。改成profile.set_preference('browser.helperApps.neverAsk.saveToDisk', 'application/zip')

最后更正：

   #!/usr/bin/python
    print "hello from python 2"

    import urllib2
    from selenium import webdriver
    from selenium.webdriver.common.keys import Keys
    import time
    from pyvirtualdisplay import Display
    import requests, zipfile, os    

    display = Display(visible=0, size=(800, 600))
    display.start()

    profile = webdriver.FirefoxProfile()
    profile.set_preference('browser.download.folderList', 2)
    profile.set_preference('browser.download.manager.showWhenStarting', False)
    profile.set_preference('browser.download.dir', "/home/vinvin/shKLSE/")
    # application/zip not /zip
    profile.set_preference('browser.helperApps.neverAsk.saveToDisk', 'application/zip')

    for retry in range(5):
        try:
            browser = webdriver.Firefox(profile)
            print "firefox"
            break
        except:
            time.sleep(3)
    time.sleep(1)

    browser.get("https://www.shareinvestor.com/my")
    time.sleep(10)
    login_main = browser.find_element_by_xpath("//*[@href='/user/login.html']").click()
    print browser.current_url
    username = browser.find_element_by_id("sic_login_header_username")
    password = browser.find_element_by_id("sic_login_header_password")
    print "find id done"
    username.send_keys("bkcollection")
    password.send_keys("123456")
    print "log in done"
    login_attempt = browser.find_element_by_xpath("//*[@type='submit']")
    login_attempt.submit()
    browser.get("https://www.shareinvestor.com/prices/price_download.html#/?type=price_download_all_stocks_bursa")
    print browser.current_url
    time.sleep(20)
    dl = browser.find_element_by_xpath("//*[@href='/prices/price_download_zip_file.zip?type=history_all&market=bursa']").click()
    time.sleep(30)

    browser.close()
    browser.quit()
    display.stop()

   zip_ref = zipfile.ZipFile('/home/vinvin/shKLSE/file.zip', 'r')
   zip_ref.extractall('/home/vinvin/shKLSE')
   zip_ref.close()
   # remove with correct path
   os.remove('/home/vinvin/shKLSE/file.zip')

我没有在您提到的网站上尝试过，但是以下代码可以完美运行并下载 ZIP。如果您无法下载 zip，则 Mime 类型可能不同。您可以使用 chrome 浏览器和网络检查来检查您尝试下载的文件的MIME 类型。

profile = webdriver.FirefoxProfile()
profile.set_preference('browser.download.folderList', 2)
profile.set_preference('browser.download.manager.showWhenStarting', False)
profile.set_preference('browser.download.dir', "/home/vinvin/shKLSE/")
profile.set_preference('browser.helperApps.neverAsk.saveToDisk', 'application/zip')

browser = webdriver.Firefox(profile)
browser.get("http://www.colorado.edu/conflict/peace/download/peace.zip")