久久精品综合一区二区三区,亚洲国产成人久久综合野外,亚洲第一永久AV网站久久精品男人的天堂AV

vs2017 linux �~�译输出�Ҏ�� vs 格式

金庆 — Wed, 21 Nov 2018 02:57:00 GMT

vs2017 linux �~�译输出�Ҏ�� vs 格式

(金庆的专�?2018.11)

1 #!/usr/bin/python
2 # -*- coding: utf-8 -*-
3
4 '''
5 gcc2vs.py
6
7 功能�Q?br /> 8 ��剪切板中gcc的编译输出格式�{成vs格式�Q�用于vs跌��{到错误行�?br /> 9 vs2017 linux �~�译输出�?nbsp;gcc 格式�Q�无法点击蟩转，如：
10 /var/tmp/src/dbe/Linux-Debug/Src/Team.cpp:16:1: 错误�Q?#8216;x’不是一个类型名
11 ��{为vs格式, �?br />12 /var/tmp/src/dbe/Linux-Debug/Src/Team.cpp(16):1: 错误�Q?#8216;x’不是一个类型名
13
14 如何使用�Q?br />15
16 首先��d��?nbsp;python, �q�安�?nbsp;pyperclip
17 pip install pyperclip
18
19 假设本文件�ؓ d:/tools/gcc2vs.py,
20 vs讄��外部工具�Q�工�?>外部工具->��d��
21   标题�Q�gcc2vs(&V)
22   命��o�Q�python.exe
23   参数�Q�d:/tools/gcc2vs.py
24   选中"使用输出�H�口"
25
26 参考：VS2010手动��d��外部工具和快捷键
27 https://www.cnblogs.com/ChinaHook/p/4698733.html
28
29 当Linux构徏输出后，点击输出�H�口�Q�ctrl-A 选择全部�Q�ctrl-C 复制输出到剪切板�Q?br />30 然后 alt-T,V �q�行��d��的外部工�?nbsp;gcc2vs(&V), 更改输出格式�Q�然后就可以点击错误跌��{了�?br />31 '''
32
33 import re
34 import pyperclip
35
36 # 待替换的格式
37 pattern = re.compile(r'/var/tmp/src/..-.-.-.-/Linux-Debug/(.*):([0-9]*):([0-9]*): ')
38
39 test_lines_src = '''
40 /var/tmp/src/db71a8ec-90bb-2838-98df-2dd35e71166e/Linux-Debug/003_servers/103_LobbyServer/Src/Team.cpp:16:1: 错误�Q?#8216;x’不是一个类型名
41 生成��p�|�?br />42 '''
43 test_lines_dst = '''
44 003_servers/103_LobbyServer/Src/Team.cpp(16):1: 错误�Q?#8216;x’不是一个类型名
45 生成��p�|�?br />46 '''
47 assert test_lines_dst == re.sub(pattern, r'\1(\2):\3: ', test_lines_src)
48
49 # 剪切板中的gcc格式输出
50 src = pyperclip.paste()
51 # 转成vs格式
52 dst = re.sub(pattern, r'\1(\2):\3: ', src)
53 print(dst)
54

金庆 2018-11-21 10:57 发表评论

xlsx扚w��转�ؓutf8的csv

金庆 — Fri, 30 Oct 2015 08:05:00 GMT

xlsx扚w��转�ؓutf8的csv

(金庆的专�?

�{�划的配�|�表�?xlsx 表格�Q�可以有注释�Q�公式�?br />服务器和客户端��用的配置文�g需要�{�?csv 文�g�?br />使用 WPS 另存无法扚w��转换�Q��ƈ且结果不是utf8�~�码的，�q�需要用Notepad++转编码�?br />
除了 xlsx 转�ؓ csv, 其他格式文�g保持原样�Q�如 *.ini, *.xml, *.lua.
server/ 子目录特�D�处理，不能复制到客��L��?br />
用python脚本实现�Q�依�?openpyxl 库�?br />
#!/usr/bin/env python
# coding: utf-8
# datatab.py
# 从策划配�|�表目录 game\Design\配置表\”
#   生成服务器的 game\Program\server\six\datatab\” 目录�Q?br />#   和客��L��?game\Program\client\Assets\Config\” 目录�?br />#   所有xlsx文�g生成csv文�g�Q�其他文件原样复制�?br />#   其中 server\ 目录�Ҏ��处理�Q�仅�Ҏ��务器有效�Q�客��L��跌��?
#
# 依赖openpyxl库：http://openpyxl.readthedocs.org/en/latest/
# 参考代�?http://segmentfault.com/q/1010000003006437?_ea=273128
# ��试环境�Q�Python3.4

# Usage: datatab.py
# Example: datatab.py "d:\game"
# 是根目录�Q�包含Design/, Program/ 目录�?br />
from openpyxl import Workbook
from openpyxl.compat import range
from openpyxl.cell import get_column_letter
from openpyxl import load_workbook
import csv
import os
import sys
import shutil

def xlsx2csv(filename):
    # try:
        xlsx_file_reader = load_workbook(filename = filename, data_only = True)
        for sheet in xlsx_file_reader.get_sheet_names():
            # 仅第1个sheet输出��C��个csv文�g中，文�g名后�~�替换�?csv
            csv_filename = os.path.splitext(filename)[0] + '.csv'
            csv_file = open(csv_filename, 'w', encoding='utf8', newline='')
            csv_file_writer = csv.writer(csv_file)
            sheet_ranges = xlsx_file_reader[sheet]
            for row in sheet_ranges.rows:
                row_container = []
                for cell in row:
                    row_container.append(cell.value)
                csv_file_writer.writerow(row_container)
            # End of for row.
            csv_file.close()
            break # 仅输出第1个sheet
        # End of for sheet.
    # End of try.
    # except Exception as e:
    #    print(e)
# End of xlsx2csv().

def datatab_convert(game_dir):
    '''�?game\Design\配置表\ 输出�?br />      game\Program\server\six\datatab\
      game\Program\client\Assets\Config\
    '''
    design_dir = os.path.join(game_dir, 'Design/配置�?')
    server_dir = os.path.join(game_dir, 'Program/server/six/datatab/')
    client_dir = os.path.join(game_dir, 'Program/client/Assets/Config/')

    # 删除旧文件�?br />    print("Delete " + server_dir)
    try:
        shutil.rmtree(server_dir)
    except:
        pass
    print("Delete " + client_dir)
    try:
        shutil.rmtree(client_dir)
    except:
        pass

    # 生成server文�g
    print("Creating " + server_dir)
    shutil.copytree(design_dir, server_dir)
    files = get_files(server_dir)
    convert_files(files)

    # 复制client文�g
    print("Copy " + client_dir)
    shutil.copytree(server_dir, client_dir)
    shutil.rmtree(os.path.join(client_dir, 'server/'))
    print("Done. Total files: %d" % len(files))
# End of datatab_convert().

def get_files(dir):
    '''Get a list of files under input dir.'''
    result = []
    for root,dirs,files in os.walk(dir):
        for f in files:
            result.append(os.path.join(root, f))
    return result
# End of get_files().

def convert_files(files):
    '''转换一�Ҏ��?
    files 是列表，元素为完整�\径名�?br />    '''
    for f in files:
        ext = os.path.splitext(f)[1].lower()
        if '.xlsx' != ext:
            print(f + " -> keep")
            continue
        print(f + " -> csv")
        xlsx2csv(f)
        os.remove(f)
# End of convert_files().

if __name__ == '__main__':
    if len(sys.argv) != 2:
        print('usage: datatab ')
    else:
        datatab_convert(sys.argv[1])
    sys.exit(0)

# Usage: datatab.py
# Example: datatab.py "d:\game"
# 是SVN根目录，包含Design/, Program/ 目录�?br />
为方便��用，��datatab.py 打包�?exe, �q�样不能安装Python��p��q�行�?br />下蝲�q�安装Python3, 安装openpyxl包，保证本地可以�q�行 datatab.py.
下蝲�q�安装PyInstaller�Q?br />    pip install pyinstaller
�q�行
    pyinstaller --onefile datatab.py

ImportError: No module named 'jdcal'
可能openpyxl安装时自带的jdcal无法扑ֈ��Q�删�?
C:\Python34\Lib\site-packages\jdcal-1.0-py3.4.egg
重新安装�Q�pip install jdcal

金庆 2015-10-30 16:05 发表评论

如何�q�行 rpcz python example

金庆 — Wed, 11 Dec 2013 02:12:00 GMT

试着�q�行 rpcz-python �?example。过�E�记录如下�?br />
假设protobuf-py已经按照protobuf的安装说明安装了�?br />发现 protobuf-2.5.0版的python包是python2的，没有扑ֈ�python3的�?br />试着2to3.py转换一下，�l�果转换后无法安装�?br />只好��python3.3换成python2.7

python2.7的mimetypes.py有错误，注册表中HKEY_CLASSES_ROOT有中文的扩展名时�Q?br />安装setuptools��p�|�Q�参�?http://www.oschina.net/question/1409342_134600

先编�?rpz, ��生成的
protoc-gen-cpp_rpcz.exe
protoc-gen-python_rpcz.exe
复制到系�l�搜索目录，如与protoc.exe攑֜�一赗��?br />
�q�入 rpcz �?python 目录�Q�运�?br />python setup.py install

出现如下的各�U�错误：
../include\rpcz/connection_manager.hpp(21) : fatal error C1083: Cannot open incl
ude file: 'boost/function.hpp': No such file or directory
../include\rpcz/macros.hpp(20) : fatal error C1083: Cannot open include file: 'g
oogle/protobuf/stubs/common.h': No such file or directory
../include\rpcz/rpc.hpp(24) : fatal error C1083: Cannot open include file: 'rpcz
/rpcz.pb.h': No such file or directory
LINK : fatal error LNK1181: cannot open input file 'rpcz.lib'
LINK : fatal error LNK1104: cannot open file 'libboost_thread-vc100-mt-1_54.lib'

直接改了setup.py如下�?br />
    ext_modules=[
        Extension("rpcz.pywraprpcz", ["cython/pywraprpcz.cpp"],
                  libraries=["rpcz", "libprotobuf", "libzmq"],
                  include_dirs=['../include', '../build/src',
                      'D:/Boost/include/boost-1_54',
                      'G:/workspace/rpcz_jinq/src',
                      'D:/LibSrc/protobuf-2.5.0/vsprojects/include'],
                  library_dirs=['../build/deps/lib', '../build/src/rpcz',
                      'D:/Boost/lib',
                      'G:/workspace/rpcz_jinq/src/rpcz/Release',
                      'D:/LibSrc/zeromq-4.0.3/builds/msvc/Release',
                      'D:/LibSrc/protobuf-2.5.0/vsprojects/Release'],
                  language='c++')
    ],

不知道如何做成通用的脚本�?br />rpcz原来应该是徏立一个固定位�|�的build目录�Q�其中有deps目录�Q�包含所有库�?br />�q�就要求cmake的构建目录固定�ؓbuild.

python2.7是用VC2008�~�译的，用VC2010�~�译python扩展会有问题�?br />会报错：
error: Unable to find vcvarsall.bat
强制使用VC2010:
SET VS90COMNTOOLS=%VS100COMNTOOLS%
参考：http://stackoverflow.com/questions/2817869/error-unable-to-find-vcvarsall-bat

最后进�?examples\python�Q�先 generate_protos.gy 生成消息和接口，然后�q�行 server, client.
�q�行旉��?libzmq.dll, rpcz.dll.

金庆 2013-12-11 10:12 发表评论

Windows上Python��d��stdin出错

金庆 — Wed, 11 Apr 2012 02:56:00 GMT

Windows上Python��d��stdin出错

�Q�金庆的专栏�Q?br />
一�D늮�单的代码�Q�读取stdin, 替换输出到stdout:

#!/usr/bin/env python
import os, sys
input_file = sys.stdin
output_file = sys.stdout
for s in input_file:
output_file.write(s.replace("abc", "def"))

代码改自CookBook�?nbsp;
Recipe 2.3. Searching and Replacing Text in a File

在Linux上运行正常：
$ cat input.txt | ./replace.py

但是在Windows的Dos�H�口�q�行会报错：
> type input.txt | replace.py
Traceback...
for s in input_file:
IOError: [Errno 9] Bad file descriptor

如果用python调用��正常：
> type input.txt | python replace.py

原因是cmd.exe通过后缀兌��q�行py文�g存在问题�?br />详见�Q�Bad pipe filedescriptor when reading from stdin in python
http://stackoverflow.com/questions/1057638/bad-pipe-filedescriptor-when-reading-from-stdin-in-python

It seems that stdin/stdout redirect does not work when starting from a file association. This is not specific to python, but a problem caused by win32 cmd.exe.

金庆 2012-04-11 10:56 发表评论

金庆 — Thu, 19 Jan 2012 08:21:00 GMT

建立Socket Policy服务�?br />
�Q�金庆的专栏�Q?br />
Flash和Unity3D游戏服务器需要开启一个Socket Policy服务器�?br />详细说明见：Setting up a socket policy file server
http://www.adobe.com/devnet/flashplayer/articles/socket_policy_files.html

协议如下�Q?br />Flash或U3D播放器向Socket Policy服务器发送请求：
“\0”�Q?br />服务器返回一个xml文本�Q�其中有包含配置�?br />
Adobe提供了Perl和Python代码。Unity3D提供了CSharp代码�?br />cs代码用于Windows. Linux上准备��用Python代码�?br />在以上网��下载：flashpolicyd_v0.6.zip�?br />其中�?个版本：init服务�Q�xinetd服务�Q�独立应用。只需一�U�即可�?br />
按应用的性质�Q�请求量极小�Q�所以最适合应用xinetd.
只需�q�行其中的install.sh��׃��安装�?br />�q�需手工�?ect/services中添加服务名flashpolicy和端�?43.

�q�行以下指��o可以��试一下，输出应该是配�|�文件的内容�?br />python -c 'print "%c" % 0' | nc 127.0.0.1 843

其实以上��试指��o在尾部多了个'\n', 不是标准的测试�?br />在in.flashpolicyd.py中多了个strip()去除�q�个'\n'.

实际用U3D��试�Ӟ��因�ؓ没有'\n'�l�尾�Q�所以in.flashpolicyd.py无法正常工作�?br />需要将35行readline()如下更改�Q?br /> request = sys.stdin.readline().strip()
改�ؓ
request = sys.stdin.readline(len('\0')).strip()
�q�样��׃��需要eol��可以读取了�?br />
查看其他两个版本的代码没有这个错误，但是有另一个错误，
��x��可能只读一半的��h��造成判断出错�?br />
�q�有一个问题是因�ؓ服务是由nobody�q�行的，环境变量不同�Q?br />��in.flashpolicyd.py头部�?br />#!/usr/bin/env python
明确�?br />#!/usr/local/sbin/python
可避免调用低版本的python而报错�?br />

金庆 2012-01-19 16:21 发表评论

金庆 — Wed, 22 Dec 2010 10:56:00 GMT

摘要: 输入4个数�? 输出所有用加减乘除�l�果�?4的表辑ּ�. 代码如下: 阅读全文

金庆 2010-12-22 18:56 发表评论

(Python�~�程)Pickle对象

金庆 — Fri, 03 Jul 2009 08:37:00 GMT

Programming Python, 3rd Edition ��译
最新版本见�Q?a >http://wiki.woodpecker.org.cn/moin/PP3eD

19.4. Pickled Objects

19.4. Pickle对象

Probably the biggest limitation of DBM keyed files is in what they can store: data stored under a key must be a simple text string. If you want to store Python objects in a DBM file, you can sometimes manually convert them to and from strings on writes and reads (e.g., with str and eval calls), but this takes you only so far. For arbitrarily complex Python objects such as class instances and nested data structures, you need something more. Class instance objects, for example, cannot be later re-created from their standard string representations. Custom to-string conversions are error prone and not general.

DBM 键控文�g�Q�DBM keyed file�Q�最大的限制也许在于他们可以存储的东西：一个键��g��存储的数据必��L��个简单文本字�W�串。如果您惌��在DBM文�g中储存Python对象�Q�有时您可以在读写的时候，手动�q�行与字�W�串的�{换（例如�Q�用str和eval调用�Q�，但只能做到这栗��对��L��复杂的Python对象�Q�如�c�d��例和嵌套的数据结构，您需要更多的东西。例如，�c�d��例对象以后无法从其标准字�W�串表达�Q�string representation�Q�重建。自定义的到字符串的转换�Ҏ��出错�Q��ƈ且不通用�?

The Python pickle module, a standard part of the Python system, provides the conversion step needed. It converts nearly arbitrary Python in-memory objects to and from a single linear string format, suitable for storing in flat files, shipping across network sockets between trusted sources, and so on. This conversion from object to string is often called serializationarbitrary data structures in memory are mapped to a serial string form.

Python �pȝ��的标准部�Ӟ��pickle模块�Q�提供了所需的�{换步骤。它可以��几乎�Q意的Python内存对象�Q��{换�ؓ单一�U�性的字符串格式，使之适于无格式文件存储，或在可靠来源之间跨越�|�络套接口传输等�{�，�q�可反向转换。这�U�从对象到字�W�串的�{换通常被称为序列化�Q�serialization�Q�：��内存中的�Q�? 数据�l�构映射��Z��行字�W�串形式�?

The string representation used for objects is also sometimes referred to as a byte stream, due to its linear format. It retains all the content and references structure of the original in-memory object. When the object is later re-created from its byte string, it will be a new in-memory object identical in structure and value to the original, though located at a different memory address. The re-created object is effectively a copy of the original.

对象的字�W�串表达�׃��其线性的格式�Q�有时也被称为字节流。它包含了原始内存中对象的所有内容和引用�l�构。当对象后来从其字节串重建时�Q�内存中新徏的对象与原对象具有相同的�l�构和��|��但位于不同的内存地址。该重徏对象实际上是原对象的复制�?

Pickling works on almost any Python datatypenumbers, lists, dictionaries, class instances, nested structures, and moreand so is a general way to store data. Because pickles contain native Python objects, there is almost no database API to be found; the objects stored are processed with normal Python syntax when they are later retrieved.

Pickle可用于几乎所有的Python数据�c�d��Q�数字、列表、字典、类实例、嵌套结构，�{�等�Q�因此它是存储数据的通用�Ҏ��。因为pickle包含的是Python本地对象�Q�所以几乎没有数据库的API�Q�对象存储与处理及后来的提取用的都是通常的Python语法�?

19.4.1. Using Object Pickling

19.4.1. 使用对象pickle

Pickling may sound complicated the first time you encounter it, but the good news is that Python hides all the complexity of object-to-string conversion. In fact, the pickle module 's interfaces are incredibly simple to use. For example, to pickle an object into a serialized string, we can either make a pickler and call its methods or use convenience functions in the module to achieve the same effect:

�W? 一�ơ听到pickle�Q�可能觉得有点复杂，但好消息是，Python隐藏了所有从对象到字�W�串转换的复杂性。事实上�Q�pickle模块的接口简单易用，�� 直��o人难以置信。例如，要pickle对象��C��个序列化字符�Ԍ��我们可以生成一个pickler�Q��ƈ调用其方法，或��用模块中的便捷函数来辑ֈ�相同的效果：

P = pickle.Pickler( file)

Make a new pickler for pickling to an open output file object file.
生成一个新的pickler�Q�用来pickle��C��个打开的输出文件对象file�?

P.dump( object)

Write an object onto the pickler's file/stream.
写一个对象到pickler的文�?��?

pickle.dump( object, file)

Same as the last two calls combined: pickle an object onto an open file.
�{�同于上两个调用的组合：pickle对象��C��个打开的文件�?

string = pickle.dumps( object)

Return the pickled representation of object as a character string.
�q�回一个字�W�串作�ؓ已pickle对象的表达�?

Unpickling from a serialized string back to the original object is similarboth object and convenience function interfaces are available:

从一个序列化字符串unpickle回原始对象是�c�M��的，可以用对象也可以用便捷函数接口：

U = pickle.Unpickler( file)

Make an unpickler for unpickling from an open input file object file.
生成一个unpickler�Q�用来从一个打开的文件对象file unpickle�?

object = U.load( )

Read an object from the unpickler's file/stream.
从unpickler的文�?��读取一个对象�?

object = pickle.load( file)

Same as the last two calls combined: unpickle an object from an open file.
�{�同于上两个调用的组合：从一个打开的文件unpickle一个对象�?

object = pickle.loads( string)

Read an object from a character string rather than a file.
从字�W�串��d��一个对象，而不是从文�g�?

Pickler and Unpickler are exported classes. In all of the preceding cases, file is either an open file object or any object that implements the same attributes as file objects:

Pickler和Unpickler是导出类。在上述所有情况下�Q�file是个已打开的文件对象，或者是实现了以下文件对象属性的��M��对象�Q?

Pickler calls the file's write method with a string argument.

Pickler会调用文件的write�Ҏ��Q�参数是个字�W�串�?

Unpickler calls the file's read method with a byte count, and readline without arguments.

Unpickler会调用文件的read�Ҏ��Q�参数是字节敎ͼ�以及readline�Q�无参数�?

Any object that provides these attributes can be passed in to the file parameters. In particular, file can be an instance of a Python class that provides the read/write methods (i.e., the expected file-like interface). This lets you map pickled streams to in-memory objects with classes, for arbitrary use. For instance, the StringIO standard library module discussed in Chapter 3 provides classes that map file calls to and from in-memory strings.

�? 何提供这些属性的对象都可以作为file参数传入。特别是�Q�file可以是一个提供了�?写方法的Python�c�d��例（即预期的�c�M��文�g的接口）。这让您可以用类映射pickle��到内存对象�Q��ƈ可�Q意��用。例如，�W?章讨论的标准库模块StringIO提供的类�Q�它们可映射文�g调用到内存字�W�串或反之�?

This hook also lets you ship Python objects across a network, by providing sockets wrapped to look like files in pickle calls at the sender, and unpickle calls at the receiver (see the sidebar "Making Sockets Look Like Files," in Chapter 13, for more details). In fact, for some, pickling Python objects across a trusted network serves as a simpler alternative to network transport protocols such as SOAP and XML-RPC; provided that Python is on both ends of the communication (pickled objects are represented with a Python-specific format, not with XML text).

�? 挂钩也可以让您通过�|�络传输Python对象�Q�只要封装套接口�Q��之看上去像发送端pickle调用中的文�g�Q�以及像接收端unpickle调用中的文�g �Q�详见第13章侧�?#8220;使套接口看上��d��文�g”�Q�。事实上�Q�对一些�h来说�Q�pickle Python对象�q�在一个值得信赖的网�l�上传输�Q�是替代如SOAP和XML-RPC之类�|�络传输协议的一个简单方法；只要通信的两端都有Python�Q�被 pickle的对象是用Python专有的格式表辄��Q�而不是用XML文本�Q��?

19.4.2. Picking in Action

19.4.2. Pickle实战

In more typical use, to pickle an object to a flat file, we just open the file in write mode and call the dump function:

典型的��用情冉|��Q�pickle对象到无格式文�g�Q�我们只需以写模式打开文�g�Q��ƈ调用dump函数�Q?

% python
>>> table = {'a': [1, 2, 3],
             'b': ['spam', 'eggs'],
             'c': {'name':'bob'}}
>>>
>>> import pickle
>>> mydb  = open('dbase', 'w')
>>> pickle.dump(table, mydb)

Notice the nesting in the object pickled herethe pickler handles arbitrary structures. To unpickle later in another session or program run, simply reopen the file and call load:

注意�q�个被pickle对象中的嵌套�Q�pickler可以处理��L��l�构。然后，在另一个会话或�E�序中unpickle�Q�只要重新打开该文�Ӟ��q�调用load�Q?

% python
>>> import pickle
>>> mydb  = open('dbase', 'r')
>>> table = pickle.load(mydb)
>>> table
{'b': ['spam', 'eggs'], 'a': [1, 2, 3], 'c': {'name': 'bob'}}

The object you get back from unpickling has the same value and reference structure as the original, but it is located at a different address in memory. This is true whether the object is unpickled in the same or a future process. In Python-speak, the unpickled object is == but is not is:

unpickle所得的对象��h��与原对象相同的值和引用�l�构�Q�但它位于不同的内存地址。无论在同一�q�程或另一�q�程unpickle�Q�都是这栗��用Python的话来说�Q�unpickle后的对象�?#8220;==”关系�Q�但不是“is”关系�Q?

% python
>>> import pickle
>>> f = open('temp', 'w')
>>> x = ['Hello', ('pickle', 'world')]           # list with nested tuple
>>> pickle.dump(x, f)
>>> f.close( )                                   # close to flush changes
>>>
>>> f = open('temp', 'r')
>>> y = pickle.load(f)
>>> y
['Hello', ('pickle', 'world')]
>>>
>>> x == y, x is y
(True, False)

To make this process simpler still, the module in Example 19-1 wraps pickling and unpickling calls in functions that also open the files where the serialized form of the object is stored.

��Z��让这一�q�程更简单，�?9-1中的模块把pickle和unpickle调用��装在函��C��Q�在函数中同时还打开文�g�Q��ƈ��对象的序列化存储在该文件中�?

Example 19-1. PP3E\Dbase\filepickle.py

   1 import pickle
   2 
   3 def saveDbase(filename, object):
   4     file = open(filename, 'w')
   5     pickle.dump(object, file)          # pickle to file
   6     file.close( )                     # any file-like object will do
   7 
   8 def loadDbase(filename):
   9     file = open(filename, 'r')
  10     object = pickle.load(file)         # unpickle from file
  11     file.close( )                     # re-creates object in memory
  12     return object

To store and fetch now, simply call these module functions; here they are in action managing a fairly complex structure with multiple references to the same nested objectthe nested list called L at first is stored only once in the file:

现在�Q�存储和提取时只需调用�q�些模块函数�Q�以下实例是个相当复杂的�l�构�Q�具有对同一嵌套对象的多重引用，该嵌套列表，即第1个L�Q�在文�g中只会保存一�ơ：

C:\...\PP3E\Dbase>python
>>> from filepickle import *
>>> L = [0]
>>> D = {'x':0, 'y':L}
>>> table = {'A':L, 'B':D}              # L appears twice
>>> saveDbase('myfile', table)          # serialize to file

C:\...\PP3E\Dbase>python
>>> from filepickle import *
>>> table = loadDbase('myfile')         # reload/unpickle
>>> table
{'B': {'x': 0, 'y': [0]}, 'A': [0]}
>>> table['A'][0] = 1                   # change shared object
>>> saveDbase('myfile', table)          # rewrite to the file

C:\...\PP3E\Dbase>python
>>> from filepickle import *
>>> print loadDbase('myfile')           # both L's updated as expected
{'B': {'x': 0, 'y': [1]}, 'A': [1]}

Besides built-in types like the lists, tuples, and dictionaries of the examples so far, class instances may also be pickled to file-like objects. This provides a natural way to associate behavior with stored data (class methods process instance attributes) and provides a simple migration path (class changes made in module files are automatically picked up by stored instances). Here's a brief interactive demonstration:

�? 了内�|�的�c�d��Q�如以上例子中的列表�Q�元�l�和字典�Q�类实例也可被pickle到类似文件的对象中。这提供了一个自然的方式来关联行��Z��存储的数据（�c�L��法处理实例的属性）�Q��ƈ提供了一条简单的�q�移路径�Q�被存储的实例将自动获得模块文�g中对�cȝ��更改�Q�。以下是个简短的交互演示�Q?

>>> class Rec:
        def _ _init_ _(self, hours):
            self.hours = hours
        def pay(self, rate=50):
            return self.hours * rate

>>> bob = Rec(40)
>>> import pickle
>>> pickle.dump(bob, open('bobrec', 'w'))
>>>
>>> rec = pickle.load(open('bobrec'))
>>> rec.hours
40
>>> rec.pay( )
2000

We'll explore how this works in more detail in conjunction with shelves later in this chapteras we'll see, although the pickle module can be used directly, it is also the underlying translation engine in both shelves and ZODB databases.

我们��与本章下面的shelve一赯��l�探讨这是如此工作的。我们将会看刎ͼ�虽然pickle模块可直接��用，但它也是shelve和ZODB数据库的底层��译引擎�?

In fact, Python can pickle just about anything, except for:

事实上，Python可以pickle��M��东西�Q�除了：

Compiled code objects; functions and classes record just their names in pickles, to allow for later reimport and automatic acquisition of changes made in module files.

�~�译的代码对象；函数和类在pickle中只是记录了它们的名字，以便后来重新导入和自动获取模块文件中的更攏V�?

Instances of classes that do not follow class importability rules (more on this at the end of the section "Shelve Files," later in this chapter).

不遵守类可导入规则（class importability rule�Q�的�c�d��例（本章后面“Shelve文�g”一节的��N��有更多相兛_��容）�?

Instances of some built-in and user-defined types that are coded in C or depend upon transient operating system states (e.g., open file objects cannot be pickled).

用C�~�码的或依赖于操作系�l�瞬态的一些内�|�的和用户定义类型的实例�Q�例如，打开的文件对象无法pickle�Q��?

A PicklingError is raised if an object cannot be pickled.

如果对象不能pickle�Q�会引发PickleError�?

19.4.3. Pickler Protocols and cPickle

19.4.3. Pickler协议和cPickle

In recent Python releases, the pickler introduced the notion of protocolsstorage formats for pickled data. Specify the desired protocol by passing an extra parameter to the pickling calls (but not to unpickling calls: the protocol is automatically determined from the pickled data):

在最�q�的Python版本中，pickler推出了协议的概念�Q�pickle数据的保存格式。通过pickle调用时传入一个额外的参数�Q�可指定所需的协议（但unpickle调用不需要：协议是自动从已pickle的数据确定的�Q�：

pickle.dump(object, file, protocol)

Pickled data may be created in either text or binary protocols. By default, the storage protocol is text (also known as protocol 0). In text mode, the files used to store pickled objects may be opened in text mode as in the earlier examples, and the pickled data is printable ASCII text, which can be read (it's essentially instructions for a stack machine).

Pickle 数据可以按文本协议或二进制协议��生。默认情况下�Q�存储协议是文本协议�Q�也�U�Cؓ0号协议）。在文本模式下，用来存储pickle对象的文件可以用文本模式打开�Q�如上述的例子，�q�且pickle的数据是可打印的ASCII文本�Q��ƈ且是可读的（�q�基本上是对堆栈机实现的指示�Q��?

The alternative protocols (protocols 1 and 2) store the pickled data in binary format and require that files be opened in binary mode (e.g., rb, wb). Protocol 1 is the original binary format; protocol 2, added in Python 2.3, has improved support for pickling of new-style classes. Binary format is slightly more efficient, but it cannot be inspected. An older option to pickling calls, the bin argument, has been subsumed by using a pickling protocol higher than 0. The pickle module also provides a HIGHEST_PROTOCOL variable that can be passed in to automatically select the maximum value.

�? 他协议（1号和2号协�? �Q�以二进制格式存储pickle数据�Q��ƈ要求文�g以二�q�制模式打开�Q�例如：rb、wb�Q��?号协议是原始二进制格式；2号协议是Python 2.3增加的，它改善了�Ҏ��型类pickle的支持。二�q�制格式效率更高一点，但它无法�q�行查看。旧的pickle调用有一个选项�Q�即bin参数�Q�现已被归入使用大于0的协议。pickle模块�q�提供了一个HIGHEST_PROTOCOL变量�Q�传入它可以自动选择最大的协议倹{�?

One note: if you use the default text protocol, make sure you open pickle files in text mode later. On some platforms, opening text data in binary mode may cause unpickling errors due to line-end formats on Windows:

注意�Q�如果您使用默认的文本协议，以后请务必以文本模式打开pickle文�g。在一些��^��C��Q�因为Windows的行��格式不同，以二�q�制模式打开文本数据可能会导致unpickle错误:

>>> f = open('temp', 'w')                  # text mode file on Windows
>>> pickle.dump(('ex', 'parrot'), f)       # use default text protocol
>>> f.close( ) 
>>>
>>> pickle.load(open('temp', 'r'))         # OK in text mode
('ex', 'parrot')
>>> pickle.load(open('temp', 'rb'))        # fails in binary
Traceback (most recent call last):
  File "", line 1, in -toplevel-
    pickle.load(open('temp', 'rb'))
 ...lines deleted...
ValueError: insecure string pickle

One way to sidestep this potential issue is to always use binary mode for your files, even for the text pickle protocol. Since you must open files in binary mode for the binary pickler protocols anyhow (higher than the default 0), this isn't a bad habit to get into:

回避�q�个潜在问题的方法之一是，��L��使用二进制模式的文�g�Q�即使是用文本pickle协议。至��对于二�q�制pickler协议�Q�高于默�?�Q�，您必��M��二进制模式打开文�g�Q�所以这不是一个坏习惯�Q?

>>> f = open('temp', 'wb')                 # create in binary mode
>>> pickle.dump(('ex', 'parrot'), f)       # use text protocol
>>> f.close( )
>>>
>>> pickle.load(open('temp', 'rb'))
('ex', 'parrot')
>>> pickle.load(open('temp', 'r'))
('ex', 'parrot')

Refer to Python's library manual for more information on the pickler. Also check out marshal, a module that serializes an object too, but can handle only simple object types. pickle is more general than marshal and is normally preferred.

请参考Python库手册，以了解更多pickler的信息。另外，��h��阅marshal�Q�它也是一个序列化对象的模块，但只能处理简单对象类型。pickle比marshal更通用�Q��ƈ通常是首选�?

And while you are flipping (or clicking) through that manual, be sure to also see the entries for the cPickle modulea reimplementation of pickle coded in C for faster performance. You can explicitly import cPickle for a substantial speed boost; its chief limitation is that you cannot subclass its versions of Pickle and Unpickle because they are functions, not classes (this is not required by most programs). The pickle and cPickle modules use compatible data formats, so they may be used interchangeably.

�? 当你��ȝ��Q�或点击�Q�Python手册�Ӟ��请一定也要看看cPickle模块的条目，它是pickle的C语言实现�Q�性能上更快。您可以昑ּ�导入 cPickle替代pickle�Q�以大幅提升速度�Q�其主要的限制是�Q�你不能�l�承该版本的Pickle和Unpickle�Q�因为它们是函数�Q�而不是类�Q�多�? �E�序�q�不要求它们是类�Q�。pickle和cPickle模块使用兼容的数据格式，所以它们可以互换��用�?

If it is available in your Python, the shelve module automatically chooses the cPickle module for faster serialization, instead of pickle. I haven't explained shelve yet, but I will now.

如果您的Python中有shelve模块�Q�它会自动选用cPickle模块�Q�而不是pickle�Q�以辑ֈ�更快的序列化。我�q�没有解释过shelve�Q�但我马上就会讲到它�?

金庆 2009-07-03 16:37 发表评论

Boost.Python中文文��下蝲

金庆 — Mon, 16 Jun 2008 03:30:00 GMT

摘要: 下蝲�Q�Boost.Python中文文��
Boost文��中Python库文档的��译�?nbsp; 阅读全文

金庆 2008-06-16 11:30 发表评论

用Boost.Python构徏混合�pȝ��

金庆 — Thu, 29 May 2008 05:11:00 GMT

摘要: Boost.Python是一个开源C++库，它提供了一个简明的IDL式的接口�Q�用于把C++�c�d��函数�l�定到Python。借助C++强大的编译时内省能力和最�q�发展的元编�E�技术，�l�定工作完全用纯C++实现�Q�而没有引入新的语法�?Boost.Python丰富的特性和高��接口�Q��得完全按混合�pȝ��设计软�g包成为可能，�q�让�E�序员以��L��q�诏的方式，同时使用 C++高效的编译时多态，和Python极端便利的运行时多态�?nbsp; 阅读全文

金庆 2008-05-29 13:11 发表评论

Python��装的性能研究

金庆 — Fri, 23 May 2008 03:39:00 GMT

摘要: SIP generates the fastest wrappers; SWIG is mature and well documented; Boost.Python most elegant integration of C++ and Python 阅读全文

金庆 2008-05-23 11:39 发表评论

金庆 — Mon, 07 Apr 2008 03:37:00 GMT

摘要: 如果不创建wxPanel�Q�只创徏wxStaticBitmap�Q�窗口大��变化时�Q�图片显�C�Z��不正常，�q�且指定囄��位置和大��无效。wxStaticBitmap的父�H�口是fmMain或pnl都可以�? 阅读全文

金庆 2008-04-07 11:37 发表评论

金庆 — Wed, 26 Mar 2008 05:23:00 GMT

摘要: XRCed是wxPython附带的UI设计器，生成xrc资源文�g�Q�也可以输出python代码。本文对XRCed输出的python代码�q�行分析�?nbsp; 阅读全文

金庆 2008-03-26 13:23 发表评论

XRC初步

金庆 — Mon, 24 Mar 2008 05:52:00 GMT

摘要: XRC的基本出发点是界面布局和程序逻辑的分��，卛_��界面布局代码采用XML的方式放在分��ȝ��文�g之中�Q�在�E�序中不涉及控�g的创建和布局�Q�只需要加载相应的资源�q�处理事件绑定即可�?nbsp; 阅读全文

金庆 2008-03-24 13:52 发表评论

扚w��html转text

金庆 — Thu, 13 Mar 2008 03:55:00 GMT

摘要: 原来的代码是参考“Recipe 12.11. Using MSHTML to Parse XML or HTML”，利用htmlfile提取文本。将当前目录下的所有html文�g转换为text文�g。jigloo�l�过�?0W+个html文�g的测试，得出�l�论�Q�htmlfile的容错比InternetExplorer.Application要差很多�?nbsp; 阅读全文

金庆 2008-03-13 11:55 发表评论

Boost.Python构徏与测试HOWTO

金庆 — Thu, 17 Jan 2008 07:14:00 GMT

摘要: 使用Boost.Python不需要“安装Boost”。这里的教程利用�?Boost.Build ��目�Q�它会在需要时自动构徏那些二进制库。当�Ӟ��也可以��用其他的�~�译�pȝ��。所有“我无法�~�译Boost.Python”的问题�Q?99%以上是因��图��用另一�U�编译系�l�，而没有先按这个教�E�做�?nbsp; 阅读全文

金庆 2008-01-17 15:14 发表评论

wxPython中XRC文�gi18n�C�Z��

金庆 — Mon, 17 Dec 2007 04:22:00 GMT

摘要: wxPython中XRC文�gi18n有两�U�方法，一�U�是使用多个XRC文�g�Q�每个语�U�一个XRC�Q�另一�U�是只用一个XRC文�g�Q�各个语�a�使用一个mo��译文�g。本文是按照“wxPython中XRC文�g�?i18N的支持”一文的指示�Q�演�C�Z��用mo文�g对XRC文�g�q�行国际化翻译�? 阅读全文

金庆 2007-12-17 12:22 发表评论

用list.sort(key)排序

金庆 — Wed, 21 Nov 2007 02:36:00 GMT

摘要: 一个文件�\径链表，需要按文�g旉��与文件名排序�Q�先按时间排�Q�时间相同按文�g名排�Q�代码如下。但是用key函数排序更高效。因为key只对每个��应用一�ơ，然后按key值排序。而cmp函数必须两两比较才行�?nbsp; 阅读全文

金庆 2007-11-21 10:36 发表评论

金庆 — Thu, 20 Sep 2007 01:44:00 GMT

摘要: Programming Python, 3rd Edition ��译。本节列举了几个��短的C�E�序�Q�它们以一�U��Ş式或另一�U��Ş式运行Python代码�Q�来演示实际的通用的内嵌技术�?nbsp; 阅读全文

金庆 2007-09-20 09:44 发表评论

使用Python的logging.config

金庆 — Mon, 03 Sep 2007 03:35:00 GMT

摘要: 使用Python的logging.config.Python的logging模块接口仿log4j�Q�概念上一��_��使用上相当方�ѝ��利用logging.config.fileConfig()�Q�可以将日志的配�|�用文�g来描�q�ͼ��化了日志的初始化。例�E��?nbsp; 阅读全文

金庆 2007-09-03 11:35 发表评论

(Python�~�程)Jython�Q�Java的Python

金庆 — Wed, 08 Aug 2007 10:52:00 GMT

摘要: Jython�Q�以前叫JPython�Q�是Python�~�程语言一个完全独特的实现�Q�它让程序员能够在基于Java的应用中使用Python�Q�� Python成�ؓ一个易用的脚本部�g。Jython使Python代码看�v来像Java代码�Q�因此可以��用各�U�源自Java世界的技术。Jython也提供了接口�Q�允许Java�E�序执行Jython代码。Jython的jython�E�序�{�同于本书中一直��用的python执行�E�序�?nbsp; 阅读全文

金庆 2007-08-08 18:52 发表评论

金庆 — Tue, 24 Jul 2007 02:24:00 GMT

摘要: 有关XRC I18N的第一个中文文档。�{自[python-chinese]。用XRC生成wxPython的界�?如何实现I18N�? wxPython的XRC支持包括了对i18N的支持�? 阅读全文

金庆 2007-07-24 10:24 发表评论

Python logging RotatingFileHandler bug

金庆 — Mon, 23 Jul 2007 03:13:00 GMT

摘要: doRollover()会因为rename()出错而中途退出，造成日志文�g没有打开�Q��ƈ且后�l�的日志消息都因为日志文件没有打开而失败。我认�ؓ正确的处理是丢弃当前一条日志，或者超出日志文件大��限�q�行附加。如果日志文件打开��p�|�Q�应该�{向标准错误输出，�q�能在一定时间后重新��试打开日志文�g�?
阅读全文

金庆 2007-07-23 11:13 发表评论

金庆 — Wed, 18 Jul 2007 07:38:00 GMT

摘要: 解决__file__或sys.argv[0]在py2exe下失效的问题。选自pathutils模块�? These functions get us our directory name # Even if py2exe or another freeze tool has been used 阅读全文

金庆 2007-07-18 15:38 发表评论

久久精品综合一区二区三区,亚洲国产成人久久综合野外,亚洲第一永久AV网站久久精品男人的天堂AV

vs2017 linux �~�译输出�Ҏ�� vs 格式

xlsx扚w��转�ؓutf8的csv

如何�q�行 rpcz python example

Windows上Python��d��stdin出错

(Python�~�程)Pickle对象

Boost.Python中文文���下蝲

用Boost.Python构徏混合�pȝ��

Python���装的性能研究

XRC初步

扚w��html转text

Boost.Python构徏与测试HOWTO

wxPython中XRC文�gi18n�C�Z��

用list.sort(key)排序

使用Python的logging.config

(Python�~�程)Jython�Q�Java的Python

Python logging RotatingFileHandler bug

Boost.Python中文文��下蝲

Python��装的性能研究