Add configs to run int4 inference#37

RezaYazdaniAminabadi wants to merge 5 commits into

huggingface:mainhuggingface/transformers-bloom-inference:mainfrom

RezaYazdaniAminabadi:int4-bloomRezaYazdaniAminabadi/transformers-bloom-inference:int4-bloomCopy head branch name to clipboard