Mercurial > repos > enis > gcp_batch_netcat
annotate gcp_batch_netcat.xml @ 7:fcfb703748b1 draft
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
author | enis |
---|---|
date | Thu, 24 Jul 2025 22:32:12 +0000 |
parents | d25792770df8 |
children | 7c660a6be068 |
rev | line source |
---|---|
5
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
1 <tool id="gcp_batch_netcat" name="GCP Batch Netcat" version="0.2.0"> |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
2 <description>Submit a job to GCP Batch to test network connectivity.</description> |
0
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
3 <requirements> |
4
2ff4a39ea41b
planemo upload commit 1bf6938d35be8e67e317f504f43f281ce7dc06e6
enis
parents:
2
diff
changeset
|
4 <container type="docker">afgane/gcp-batch-netcat:0.2.0</container> |
0
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
5 </requirements> |
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
6 <command><![CDATA[ |
5
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
7 python3 '$__tool_directory__/gcp_batch_netcat.py' |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
8 --output '$output' |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
9 --project '$project' |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
10 --region '$region' |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
11 --service_account_key '$service_account_key' |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
12 --network '$network' |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
13 --subnet '$subnet' |
7
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
14 --nfs_address '$nfs_address' |
0
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
15 ]]></command> |
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
16 <inputs> |
5
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
17 <param name="region" type="text" label="GCP Batch Region" optional="false" help="Region where the Batch job will run (e.g., us-central1)"/> |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
18 <param name="network" type="text" label="GCP Network name" optional="false" help="VPC network name where Galaxy is deployed"/> |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
19 <param name="subnet" type="text" label="GCP Subnet name" optional="false" help="Subnet name where Galaxy is deployed"/> |
2
79160beab2a4
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
1
diff
changeset
|
20 <param name="service_account_key" type="data" format="json" label="GCP Service Account Key File" help="JSON key file for GCP service account with Batch API permissions"/> |
5
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
21 <param name="project" type="text" label="GCP Project ID" help="The ID of the GCP project to use. If not provided, will be extracted from the service account key." optional="true"/> |
7
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
22 <param name="nfs_address" type="text" label="NFS Server Address" help="The LoadBalancer external IP address of the NFS server (e.g., 10.150.0.17). This must be the external IP, not the internal ClusterIP." optional="false"/> |
0
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
23 </inputs> |
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
24 <outputs> |
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
25 <data name="output" format="txt"/> |
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
26 </outputs> |
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
27 <help><![CDATA[ |
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
28 **What it does** |
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
29 |
6
d25792770df8
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
5
diff
changeset
|
30 This tool submits a job to GCP Batch to test network connectivity between Batch workers and your NFS server. It provides network debugging to help identify connectivity issues in Galaxy deployments on Google Kubernetes Engine (GKE). |
5
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
31 |
7
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
32 **Required: NFS LoadBalancer External IP** |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
33 |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
34 You must provide the external IP address of your NFS server's LoadBalancer service. This is crucial because: |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
35 - Galaxy sees the NFS server via its internal ClusterIP (e.g., 10.96.0.1) |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
36 - GCP Batch jobs run outside the cluster and need the LoadBalancer external IP (e.g., 10.150.0.17) |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
37 |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
38 **Finding Your NFS LoadBalancer IP** |
5
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
39 |
7
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
40 To find the correct IP address, run: |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
41 ``` |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
42 kubectl get svc | grep nfs |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
43 kubectl get svc <nfs-service-name> -o wide |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
44 ``` |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
45 |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
46 Look for the "EXTERNAL-IP" column for LoadBalancer type services. |
6
d25792770df8
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
5
diff
changeset
|
47 |
d25792770df8
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
5
diff
changeset
|
48 **Important: LoadBalancer Configuration** |
d25792770df8
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
5
diff
changeset
|
49 |
d25792770df8
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
5
diff
changeset
|
50 For NFS connectivity from GCP Batch jobs, your NFS server must be exposed via a LoadBalancer service with an external IP. Internal ClusterIP services are not accessible from external Batch workers. |
5
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
51 |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
52 **Troubleshooting Network Issues** |
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
53 |
6
d25792770df8
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
5
diff
changeset
|
54 The tool helps identify the root cause of connectivity issues: |
d25792770df8
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
5
diff
changeset
|
55 - **Connection timeouts**: Usually indicates firewall rules blocking traffic or NFS service not accessible externally |
d25792770df8
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
5
diff
changeset
|
56 - **DNS resolution failures**: May indicate DNS configuration issues |
7
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
57 - **Wrong IP address**: Ensure you're using the LoadBalancer external IP, not the ClusterIP |
5
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
58 |
6
d25792770df8
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
5
diff
changeset
|
59 **Best Practices** |
5
b2ce158b4f22
planemo upload commit ece227052d14d755b0d0b07a827152b2e98fb94b
enis
parents:
4
diff
changeset
|
60 |
7
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
61 1. Ensure your NFS service is exposed as type LoadBalancer with an external IP |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
62 2. Verify GCP firewall rules allow traffic from Batch subnet to NFS LoadBalancer IP on port 2049 |
fcfb703748b1
planemo upload for repository https://github.com/afgane/gcp_batch_netcat commit ece227052d14d755b0d0b07a827152b2e98fb94b-dirty
enis
parents:
6
diff
changeset
|
63 3. Test the connection manually: `telnet <EXTERNAL-IP> 2049` |
0
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
64 ]]></help> |
7852c0efafd7
planemo upload for repository https://github.com/afgane/gcp_batch_netcat
enis
parents:
diff
changeset
|
65 </tool> |