Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This page will contain the activity log of the pyFF+ experiments and endeavours.

Memory usage investigation


Code Block
from guppy import hpy
import code
hp=hpy()
...
hp.setrelheap()
...

# just print the heap somewhere:h = hp.heap()
log.debug(f"\nheapy: {h}")

# or possibly interrupt the code execution and inspect the hp object:
code.interact(local=dict(globals(), **locals()))

Un/Pickling etree.ElementTree object

Code Block
# Create pickled datafile
source = open("edugain.xml", "r", encoding="utf-8")
sink = open("edugain.pkl", "w")

t = objectify.parse(source)
p = pickle.dumps(t).decode('latin1')
sink.write(p)

# Read pickled object back in pyFF
def parse_xml
	return pickle.loads(io.encode('latin1'))

In metadata parser:
t = parse_xml(content) #Instead of parse_xml(unicode_stream(content))