feat: Python OSS-Fuzz build and fuzz scripts (#21)

* Upload the python project Fuzz test script

valid_projects.txt: Python project list
script_fuzz_py_final.sh: Single project test script
script_fuzz_py_batch_final.sh: Batch projects test script

* feat: Add OSS-Fuzz submodule tracking main branch

* chore: Switch oss-fuzz submodule to personal fork

* Switch oss-fuzz submodule to personal fork

* move the valid_project file

* move the .py file

* create build_oss_fuzz.py

* create run_fuzz_target.py

* split the pool.py into build_oss_fuzz and run_fuzz_target

* delete the .sh files

* translate to english

* fuzz_runner_pool.py:74

* edit stdout

* 添加空值检查

* modify stdout, delete pool.py

* indentation level check

* Remove build log write files

* Remove build log write files

* use logging mdule

* use precise logging

* use logging

* use precise exception log info

* correct type problems

* correct some mistakes

* correct some mistakes

* correct

* modify discover fuzz target

* modify the oss-fuzz dir

* Redirect the output to an empty device without retaining any output

* add always yes

* split the build script

* split the build script

* build scripts test successfully

* build.py

* collect targets first and then run

* list, tuple, ptional

* list,tuple,optional

* translate

* build_fuzz.py, run_fuzz_all_target.py

* correct

* original

* record input

* Fatal error in main program: cannot unpack non-iterable NoneType object

* name 'target_functions' is not defined
fuzz_util_instrumented.py does not seem to exist

* 准备大改

* create modify file script  add"print(data)" to each fuzz_.py

* build_fuzzer script

* modify tuple dict list

* remove stdout stderr in build fuzz

* test successfully

* rename run fuzz ds to run fuzz print1

* add print(data ) to fuzz target and rename the file with "_print1"

* oss -fuzz change

* rename the print1.py

* modify the exegesis

* modify

* modify log name

* type error

* list dict tuple

* type error

* construct errors module

* run_command module

* combine the run_command instrument to one file

* remove the  run_command

* modify

* mytype check

* mytype

* mytype

* mytype

* translate

* remove run command

* timeout - shell instrument

* correct  in out error and return Popen directly

* ready to change from rust script

* 修改build_image

* y/n

* correct repo_id and repo_name in main

* test build_image 构建日志

* add build_fuzzer

* fuzz and testgen

* correct run_one_target

* fuzz ok

* transform

* testgen  need to ^ help: add `;` here

* test successful

* example output project

* type error

* English ver

* delete privious scripts

* python template

* python template

* correct the template

* ver2 wrong template

* ok

Author: joyguoguo

.gitmodules

@@ -1,3 +1,7 @@
 [submodule "UniTSyn"]
 	path = UniTSyn
 	url = https://github.com/SecurityLab-UCD/UniTSyn.git
+[submodule "fuzz/oss-fuzz"]
+	path = fuzz/oss-fuzz
+	url = https://github.com/joyguoguo/oss-fuzz.git
+	branch = main

UniTSyn

@@ -0,0 +1,234 @@
+abseil-py
+adal
+aiohttp
+aniso8601
+ansible
+argcomplete
+arrow-py
+asn1crypto
+asteval
+astroid
+asttokens
+attrs
+autoflake
+autopep8
+azure-sdk-for-python
+babel
+black
+botocore
+bottleneck
+bz2file
+cachetools
+cffi
+chardet
+charset_normalizer
+click
+cloud-custodian
+configparser
+connexion
+coveragepy
+croniter
+cryptography
+cssselect
+dask
+decorator
+defusedxml
+digest
+dill
+distlib
+dnspython
+docutils
+ecdsa-python
+et-xmlfile
+face
+filelock
+filesystem_spec
+flask
+flask-jwt-extended
+flask-restx
+flask-wtf
+fonttools
+ftfy
+g-api-auth-httplib2
+g-api-auth-library-python
+g-api-pubsub
+g-api-py-api-common-protos
+g-api-py-oauthlib
+g-api-python-bigquery-storage
+g-api-python-client
+g-api-python-cloud-core
+g-api-python-firestore
+g-api-python-tasks
+g-api-resource-manager
+g-api-resumable-media-python
+g-api-secret-manager
+g-apis-py-api-core
+gast
+gc-iam
+gcloud-error-py
+g-cloud-logging-py
+gcp-python-cloud-storage
+genshi
+gitdb
+glom
+gprof2dot
+g-py-bigquery
+g-py-crc32c
+grpc-py
+gunicorn
+h11
+h5py
+hiredis-py
+html2text
+html5lib-python
+httpcore
+httpretty
+httpx
+idna
+ijson
+importlib_metadata
+iniconfig
+ipaddress
+ipykernel
+ipython
+isodate
+itsdangerous
+jedi
+jinja2
+jmespathpy
+joblib
+jsmin
+jupyter-nbconvert
+jupyter_server
+kafka
+keras
+kiwisolver
+lark-parser
+libcst
+looker-sdk
+lxml
+mako
+markupsafe
+matplotlib
+mccabe
+mdit-py-plugins
+mdurl
+more-itertools
+mrab-regex
+msal
+msgpack-python
+multidict
+mutagen
+nbclassic
+nbformat
+netaddr-py
+networkx
+ntlm2
+ntlm-auth
+numexpr
+numpy
+oauth2
+oauthlib
+olefile
+openapi-schema-validator
+opencensus-python
+openpyxl
+opt_einsum
+oracle-py-cx
+orjson
+oscrypto
+packaging
+pandas
+paramiko
+parse
+parsimonious
+pasta
+pathlib2
+pdoc
+pem
+pendulum
+pip
+ply
+protobuf-python
+proto-plus-python
+psqlparse
+psutil
+psycopg2
+pyasn1
+pyasn1-modules
+pycparser
+pycrypto
+pydantic
+pydateutil
+pygments
+pyjson5
+pyjwt
+pymysql
+pynacl
+pyodbc
+pyparsing
+pyrsistent
+py-serde
+pytables
+pytest-py
+python3-openid
+python-ecdsa
+python-email-validator
+python-fastjsonschema
+python-future
+python-graphviz
+python-hyperlink
+python-jose
+python-lz4
+python-markdown
+python-markdownify
+python-nameparser
+python-nvd3
+python-pathspec
+python-prompt-toolkit
+python-pypdf
+python-rison
+python-rsa
+python-tabulate
+pytz
+pyxdg
+pyyaml
+pyzmq
+redis-py
+requests
+retry
+rfc3967
+rich
+sacremoses
+scikit-learn
+scipy
+setuptools
+sigstore-python
+simplejson
+six
+smart_open
+soupsieve
+sqlalchemy_jsonfield
+sqlalchemy-utils
+sqlparse
+stack_data
+tensorflow-addons
+tinycss2
+toml
+tomlkit
+toolbelt
+toolz
+tqdm
+typing_extensions
+underscore
+uritemplate
+urlextract
+urllib3
+validators
+w3lib
+websocket-client
+wheel
+wtforms
+xlrd
+yarl
+zipp

data/valid_projects.txt

@@ -1,5 +1,4 @@
 """script for rust fuzzing and transforming test_template"""
-
 import logging
 from typing import Optional
 import fire