Home/ Questions/Q 8139347
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-06T11:47:49+00:00

I’d like to dump structured data (mostly tabular with some additional meta data) to

  • 0

I’d like to dump structured data (mostly tabular with some additional meta data) to a file as input for another program. However, some data fields can be arbitrary unicode data. Do you know if PyYaml is a failsafe solution (which for example escapes all problem cases) or which other simple file based solution would you suggest? I’m afraid that special characters break the format or the parser.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Any good serializer will handle arbitrary Unicode, by converting it into Unicode point references.

    With YAML:

    >>> yaml.dump({'foo': u'τί ἐστίν; 統一碼!!! ✢✪✺'})
'{foo: "\\u03C4\\u1F77 \\u1F10\\u03C3\\u03C4\\u1F77\\u03BD; \\u7D71\\u4E00\\u78BC!!! \\u2722\\u272A\\\n    \\u273A"}\n'

    With JSON:

    >>> json.dumps({'foo': u'τί ἐστίν; 統一碼!!! ✢✪✺'})
'{"foo": "\\u03c4\\u1f77 \\u1f10\\u03c3\\u03c4\\u1f77\\u03bd; \\u7d71\\u4e00\\u78bc!!! \\u2722\\u272a\\u273a"}'
    • 0