我选择使用pickle(base64 TCP套接字)在我的python3代码和传统python2代码之间传递数据,但是我遇到了datetime对象的问题:
PY3对象在PY2上表现不佳,但反向在调用datetime构造函数时引发TypeError,然后在load_reduce函数中引发UnicodeEncodeError.
一个简短的测试程序&此gist中提供了日志,包括PY2和PY3泡菜的输出
>我在PY2中使用pickle.dumps(回复,协议= 2)然后在PY3中使用pickle._loads(pickled,fix_imports = True,encoding =’latin1′)(尝试无和utf-8没有成功)
>原生cPickle加载解码失败,我只使用纯python的_loads进行调试.
这是一个日期时间错误吗?也许datetime .__ getstate __ / __ setstate__实现不兼容?
欢迎任何关于代码的评论……
补充
PY-3.4.0泡菜:
0: \x80 PROTO 2
2: c GLOBAL 'datetime datetime'
21: q BINPUT 0
23: c GLOBAL '_codecs encode'
39: q BINPUT 1
41: X BINUNICODE u'\x07\xde\x07\x11\x0f\x06\x11\x05\n\x90'
58: q BINPUT 2
60: X BINUNICODE u'latin1'
71: q BINPUT 3
73: \x86 TUPLE2
74: q BINPUT 4
76: R REDUCE
77: q BINPUT 5
79: \x85 TUPLE1
80: q BINPUT 6
82: R REDUCE
83: q BINPUT 7
85: . STOP
PY-2.7.6泡菜:
0: \\x80 PROTO 2
2: c GLOBAL 'datetime datetime'
21: q BINPUT 0
23: U SHORT_BINSTRING '\\x07\xc3\x9e\\x07\\x11\\x0f\\x06\\x11\\x05\\n\\x90'
35: q BINPUT 1
37: \\x85 TUPLE1
38: q BINPUT 2
40: R REDUCE
41: q BINPUT 3
43: ] EMPTY_LIST
44: q BINPUT 4
46: N NONE
47: \\x87 TUPLE3
48: q BINPUT 5
50: . STOP
PY-3.4.0 pickle.load_reduce:
def load_reduce(self):
stack = self.stack
args = stack.pop()
func = stack[-1]
try:
value = func(*args)
except:
print(sys.exc_info())
print(func, args)
raise
stack[-1] = value
dispatch[REDUCE[0]] = load_reduce
PY-3.4.0日期泡菜支持:
# Pickle support.
def _getstate(self):
yhi, ylo = divmod(self._year, 256)
us2, us3 = divmod(self._microsecond, 256)
us1, us2 = divmod(us2, 256)
basestate = bytes([yhi, ylo, self._month, self._day,
self._hour, self._minute, self._second,
us1, us2, us3])
if self._tzinfo is None:
return (basestate,)
else:
return (basestate, self._tzinfo)
def __setstate(self, string, tzinfo):
(yhi, ylo, self._month, self._day, self._hour,
self._minute, self._second, us1, us2, us3) = string
self._year = yhi * 256 + ylo
self._microsecond = (((us1 << 8) | us2) << 8) | us3
if tzinfo is None or isinstance(tzinfo, _tzinfo_class):
self._tzinfo = tzinfo
else:
raise TypeError("bad tzinfo state arg %r" % tzinfo)
def __reduce__(self):
return (self.__class__, self._getstate())
解决方法:
解决方法是使用encoding =“bytes”,如下所示:
pickled_bytes = bytes(pickled_str, encoding='latin1') # If your input is a string(not my case)
data = pickle.loads(pickled_bytes, encoding='bytes')
(感谢Tim Peters提出的建议)
问题仍然在http://bugs.python.org/issue22005开始,为何需要这样做.