[serve] Enable HAProxy redispatch and retry-on for backend resilience#63159

harshit-anyscale wants to merge 27 commits into

ray-project:masterray-project/ray:masterfrom

harshit-anyscale:serve-haproxy-redispatchharshit-anyscale/ray:serve-haproxy-redispatchCopy head branch name to clipboard