use kube-authkit for better k8s authentication

[szaher]

Issue link

What changes have been made

Verification steps

Use the following python snippet to validate everything works with authkit

# Import pieces from codeflare-sdk and authkit
from codeflare_sdk import Cluster, ClusterConfiguration, TokenAuthentication, set_api_client
from kube_authkit import get_k8s_client, AuthConfig

token = "sha256~token"
server = "https://api.example.com:6443"

# Create authentication object for user permissions

auth_config = AuthConfig(k8s_api_host=server, token=token, verify_ssl=False)

api_client = get_k8s_client(config=auth_config)

# set the authenticated api client for codeflare sdk
set_api_client(api_client)

# Create and configure our cluster object
cluster = Cluster(ClusterConfiguration(
    name='ray-data-cpu',
    head_cpu_requests=1,
    head_cpu_limits=1,
    head_memory_requests=6,
    head_memory_limits=8,
    head_extended_resource_requests={'nvidia.com/gpu':0}, # For GPU enabled workloads 
    worker_extended_resource_requests={'nvidia.com/gpu':0},
    num_workers=1,
    worker_cpu_requests=1,
    worker_cpu_limits=1,
    worker_memory_requests=4,
    worker_memory_limits=6,
    # image="", # Optional Field 
    write_to_file=False, # When enabled Ray Cluster yaml files are written to $HOME/.codeflare/resources 
    # local_queue="local-queue-name" # Specify the local queue manually
))

# Bring up the cluster
cluster.apply()

# fetch cluster details 
cluster.details()

# delete the cluster
cluster.down()

Checks

• I've made sure the tests are passing.
• Testing Strategy
  • Unit tests
  • Manual tests
  • Testing is not required for this change

[codecov]

Codecov Report

❌ Patch coverage is 97.46835% with 2 lines in your changes missing coverage. Please review.
✅ Project coverage is 95.96%. Comparing base (ac5ae0e) to head (ac4f7db).
⚠️ Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
src/codeflare_sdk/ray/cluster/build_ray_cluster.py	71.42%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #970      +/-   ##
==========================================
+ Coverage   95.91%   95.96%   +0.05%     
==========================================
  Files          22       23       +1     
  Lines        2130     2206      +76     
==========================================
+ Hits         2043     2117      +74     
- Misses         87       89       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[kryanbeane]

Couple of nits but other than those lgtm. Haven't done a verification yet only code review

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: kryanbeane

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [kryanbeane]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[kryanbeane]

holding for more reviews
/hold

[openshift-ci]

New changes are detected. LGTM label has been removed.

[pawelpaszki]

I have verified the changes on non-byoidc cluster with provided steps from the description and executed e2e tests on byoidc and non-byoidc clusters (with additional changes for the e2e tests). all looks good