问题:

我正在尝试做一些相当简单的事情,将大型csv文件读入pandas数据帧。

data = pandas.read_csv(filepath, header = 0, sep = DELIMITER,skiprows = 2)

代码要么因为MemoryError失败,要么永远不会完成。

任务管理器中的内存使用量停止在506 Mb,并且在5分钟没有变化且没有CPU活动的过程中我停止了它。

我使用的是pandas版本0.11.0。

我知道文件解析器曾经存在内存问题,但根据http://wesmckinney.com/blog/?p=543这应该已修复。

我试图读取的文件是366 Mb,如果我将文件剪切为短(25 Mb),则上面的代码可以正常工作。

还有一个弹出窗口告诉我它无法写入地址0x1e0baf93 …

堆栈跟踪:

Traceback (most recent call last):
  File "F:\QA ALM\Python\new WIM data\new WIM data\new_WIM_data.py", line 25, in
 <module>
    wimdata = pandas.read_csv(filepath, header = 0, sep = DELIMITER,skiprows = 2
)
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\io\parsers.py"
, line 401, in parser_f
    return _read(filepath_or_buffer, kwds)
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\io\parsers.py"
, line 216, in _read
    return parser.read()
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\io\parsers.py"
, line 643, in read
    df = DataFrame(col_dict, columns=columns, index=index)
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\core\frame.py"
, line 394, in __init__
    mgr = self._init_dict(data, index, columns, dtype=dtype)
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\core\frame.py"
, line 525, in _init_dict
    dtype=dtype)
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\core\frame.py"
, line 5338, in _arrays_to_mgr
    return create_block_manager_from_arrays(arrays, arr_names, axes)
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\core\internals
.py", line 1820, in create_block_manager_from_arrays
    blocks = form_blocks(arrays, names, axes)
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\core\internals
.py", line 1872, in form_blocks
    float_blocks = _multi_blockify(float_items, items)
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\core\internals
.py", line 1930, in _multi_blockify
    block_items, values = _stack_arrays(list(tup_block), ref_items, dtype)
  File "C:\Program Files\Python\Anaconda\lib\site-packages\pandas\core\internals
.py", line 1962, in _stack_arrays
    stacked = np.empty(shape, dtype=dtype)
MemoryError
Press any key to continue . . .

一点背景 – 我试图说服人们Python可以像R一样。为此我试图复制一个R脚本

data <- read.table(paste(INPUTDIR,config[i,]$TOEXTRACT,sep=""), HASHEADER, DELIMITER,skip=2,fill=TRUE)

R不仅能够很好地读取上面的文件,它甚至可以在for循环中读取其中的几个文件(然后对数据进行一些处理)。 如果Python对那个大小的文件有问题,我可能正在打一场失败的战斗……

I am trying to do something fairly simple, reading a large csv file into a pandas dataframe.The code either fails with a MemoryError , or just never finishes.Mem usage in the task manager stopped at 506 Mb and after 5 minutes of no change and no CPU activity in the process I stopped it.I am using pandas version 0.11.0.I am aware that there used to be a memory problem with the file parser, but according to http://wesmckinney.com/blog/?p=543 this should have been fixed.The file I am trying to read is 366 Mb, the code above works if I cut the file down to something short (25 Mb).It has also happened that I get a pop up telling me that it can’t write to address 0x1e0baf93…Stacktrace:A bit of background – I am trying to convince people that Python can do the same as R. For this I am trying to replicate an R script that doesR not only manages to read the above file just fine, it even reads several of these files in a for loop (and then does some stuff with the data).If Python does have a problem with files of that size I might be fighting a loosing battle…

问题:

当我尝试这样做时,我收到以下错误:

gitignore错误

显然,Windows资源管理器不允许我创建这种类型的文件模式。 我怎样才能克服这个问题?

When I try to do this, I get the following error:Obviously, Windows Explorer doesn’t allow me to create this type of file patterns.How can I overcome this problem?

问题:

我目前在Windows Vista SP1中使用GNU Emacs 23.0.93.1。 在我的.emacs文件中,我调用(server-start)并导致错误消息目录〜/ .emacs.d / server是不安全的 有没有人见过这个并知道修复或解决方法? …除了关闭服务器;)

这是堆栈跟踪:

Debugger entered--Lisp error: (error "The directory ~/.emacs.d/server is unsafe")
  signal(error ("The directory ~/.emacs.d/server is unsafe"))
  error("The directory %s is unsafe" "~/.emacs.d/server")
  server-ensure-safe-dir("~\\.emacs.d\\server\\")
  server-start(nil)
  call-interactively(server-start t nil)
  execute-extended-command(nil)
  call-interactively(execute-extended-command nil nil)

I am currently using GNU Emacs 23.0.93.1 in Windows Vista SP1.In my .emacs file I make a call to (server-start) and that is causing an error with the message The directory ~/.emacs.d/server is unsafe .Has anyone seen this and know a fix or workaround?… other than leaving server turned off ;)Here is the stack trace:

问题:

我在安装我见过的互联网上发布的Windows SDK时遇到了一个错误,但没有一个解决方案适合我。 这是我得到的日志

9:43:37 AM Monday, October 14, 2013: SFX C:\Program Files\Microsoft SDKs\Windows\v7.1\Setup\SFX\vcredist_x64.exe installation started with log file C:\Users\clarkbd\AppData\Local\Temp\Microsoft Windows SDK for Windows 7_c3c42538-8a3e-439d-be39-aee3078ca098_SFX.log
9:43:43 AM Monday, October 14, 2013: C:\Program Files\Microsoft SDKs\Windows\v7.1\Setup\SFX\vcredist_x64.exe installation failed with return code 1603
9:43:53 AM Monday, October 14, 2013: [SDKSetup:Error] Config_Products_Install: Installation of Product Microsoft Windows SDK for Windows 7 (failed): Please refer to Samples\Setup\HTML\ConfigDetails.htm document for further information. Stack:    at SDKSetup.Product.ConfigureRelatedSfx()    at SDKSetup.Product.ConfigureNewProduct(ManualResetEvent CancelEvent)
9:43:53 AM Monday, October 14, 2013: [SDKSetup:Info] Config_Products_InstallNew: End installation of new product: Microsoft Windows SDK for Windows 7
9:43:53 AM Monday, October 14, 2013: [SDKSetup:Error] Config_Products_Install: Windows SDK Setup (failed): Installation of the "Microsoft Windows SDK for Windows 7" product has reported the following error: Please refer to Samples\Setup\HTML\ConfigDetails.htm document for further information. Stack:    at SDKSetup.Product.ConfigureNewProduct(ManualResetEvent CancelEvent)      at SDKSetup.Product.SetupProduct(TaskMode taskMode, ManualResetEvent CancelEvent)       at SDKSetup.ProductCollection.SetupProducts(TaskMode taskMode, DownloadManager downloadManager, ManualResetEvent cancelEvent)       at SDKSetup.ConfigProducts.DoCurrentTask(TaskMode Task)

当我尝试单独运行vcredist_x64时,我收到此错误:

MSI (s) (80:5C) [09:51:50:971]: Product: Microsoft Visual C++ 2010  x64 Redistributable - 10.0.30319 -- A later version of Microsoft Visual C++ 2010  x64 Redistributable - 10.0.30319 is already installed.

现在,根据我在线阅读的每个解决方案,我将卸载可再发行组件并继续安装。 问题是我没有安装任何VC ++ 2010可再发行组件(仅限2005和2008)。 除主程序之外唯一的东西是名为Microsoft Visual Studio 2010 Express Prerequisites x64 - ENU 卸载它对我收到的错误没有影响。 我的计算机上有一些东西告诉SDK我安装了这个redist,但我不知道是什么。 任何人都可以为我阐明这一点吗?

编辑:即使我完全卸载Visual C ++ 2010,此问题仍然存在。我还能从我的计算机上删除此软件的所有痕迹吗?

编辑2:稍微搜索一下注册表后,我发现NI安装了自己的visual c ++ 2010可再发行版程序,但是它没有包含在“添加或删除程序”列表中。 我已经卸载了这个,希望sdk可以正常安装。

编辑3:没有运气,仍然得到同样的错误。 我可以在注册表中找到其他2010可再发行组件,但尝试手动执行卸载字符串只是告诉我我只能在已安装的软件包上运行它。 如果我知道vcredist如何找到当前安装的重新分发,这将更加简单。

I’ve run into an error when installing the Windows SDK that I’ve seen posted around the Internet, but none of the solutions are working for me.Here is the log I’m gettingWhen I try to run vcredist_x64 separately, I get this error:Now, as per every solution I’ve read about this online, I’d uninstall the redistributable and continue with the installation.The problem is that I don’t have any VC++ 2010 redistributables installed (only 2005 and 2008).The only thing besides the main program is something called Microsoft Visual Studio 2010 Express Prerequisites x64 - ENU .Uninstalling this has no effect on the errors I receive.There’s something on my computer that’s telling the SDK I have this redist installed, but I’m not sure what.Can anyone shed some light on this for me?Edit: This problem persists even when I completely uninstall Visual C++ 2010. What else can I do to remove all traces of this software from my machine?Edit 2: After searching the registry a bit, I’ve found that NI installs its own visual c++ 2010 redistributable with one of its programs, but it isn’t included in the “Add or Remove Programs” list.I’ve uninstalled this and hopefully the sdk will install properly.Edit 3: No luck, still getting the same error.I can find other 2010 redistributables in the registry, but trying to execute the uninstall string manually just tells me that I can only run it on installed packages.This would be much simpler if I knew how the vcredist finds currently installed redistributions.

问题:

我安装了Docker,运行GUI时出现此错误:

必须在BIOS中启用硬件辅助虚拟化和数据执行保护

看起来像一个bug,因为Docker就像命令行中的魅力一样,但我想知道是否有人知道为什么会发生这种情况?

在你问之前,是的,我已经在BIOS中启用了虚拟化,并且英特尔处理器识别实用程序确认它已激活。 Docker,docker-machine和docker-从命令行编写所有工作,Virtualbox工作,从Debian或Ubuntu VM运行Docker。

关于GUI只有这个奇怪的问题。

我的规格:

  • Windows 10 Pro x64周年纪念版
  • 英特尔酷睿i5-6300HQ @ 2.30GHz

I’ve installed Docker and I’m getting this error when I run the GUI:Hardware assisted virtualization and data execution protection must be enabled in the BIOSSeems like a bug since Docker works like a charm from the command line, but I’m wondering if anyone has a clue about why this is happening?Before you ask, yes, I’ve enabled virtualization in the BIOS and the Intel Processor Identification Utility confirms that it’s activated.Docker, docker-machine and docker-compose all work from the command line, Virtualbox works, running Docker from a Debian or Ubuntu VM works.There’s just this weird issue about the GUI.My specs:Windows 10 Pro x64 Anniversary EditionIntel core i5-6300HQ @ 2.30GHz