support for several instances of sync-app

[akurach]

Hello, the main idea is to add support to create a lot of sync containers for each source to sync it simultaneously.
For example for now i have 5 vmware instances, 5 openstack and 5 oVirt. I want to create 15 docker containers for sync.

Why not it is not possible:

Every container will watch Netbox-synced tag and set all devices/vms/etc to orphaned status because source is unavailable.

Solution maybe create tag netbox-synced-%datasouce_name% and watch after this one?

Thx

[bb-Ricardo]

Hi,

The mein reason behind this is to run one sync with all sources in one job.

Usually infrastructure shares resources like subnetworks and VLANs. If you run it independently simultaneously then one instance has no idea about resources discovered in the other instances. Then you would most likely run into race conditions and errors because one instance creates/updates a resources the other instance also wants to change.

I could also add an config option like instance_tag which should solve your issue.

[akurach]

it just looks like when we have a lot of sources smthing goes wrong

04-21 09:06:42,231 - ERROR: Unfortunately updated item assigned_object_id for object 192.168.8.89/24 could not be fully resolved: <NBVMInterface instance 'vNIC 2 (dvs.VCDVSbeta-internal-net-581bc89d-ba0c-44c2-b21c-81a5e (d00in (615780c9-d11f-47c4-bda5-0be9655014c8))' at 4339062384>

lots of such errors at the end of sync

[akurach]

and a lot of devices are not synced at first run

[bb-Ricardo]

So this happens when you have them all in one settings file and do just one run?

[akurach]

Looks like local issue with vmware.. sorry.

Back to main question:
Are there any possibilities to add option in common section like "orphan_unavaliable_source" = True/False
True - if datasource is not in cfg file - mark as Orphan
False - if datasource is not in cfg file - do not mark as Orphan just sync configured.

[bb-Ricardo]

Hi, I could add something like

ignore_unknown_source_object_puning = True

would this help in your case?

[akurach]

sounds great.

[bb-Ricardo]

I just pushed a new commit to the branch development. Can you try it out and see if it works?

netbox-sync/settings-example.ini

Lines 74 to 77 in 72f6ee2

	# This will tell netbox-sync to ignore objects in NetBox with tag 'NetBox-synced' from pruning
	# if the source is not defined in this config file.
	# https://github.com/bb-Ricardo/netbox-sync/issues/176
	#ignore_unknown_source_object_pruning = False

[bb-Ricardo]

any updates on that?

[akurach]

Sorry for long response, I'll check it this week.

[akurach]

everything works as a charm! thanks! :)