Apr 27 23:45:01 devstack cinder-volume[71632]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 27 23:45:01 devstack cinder-volume[71632]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 23:45:01 devstack cinder-volume[71632]: we strongly recommend against using it for new projects. Apr 27 23:45:01 devstack cinder-volume[71632]: If you are already using Eventlet, we recommend migrating to a different Apr 27 23:45:01 devstack cinder-volume[71632]: framework. For more detail see Apr 27 23:45:01 devstack cinder-volume[71632]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 23:45:01 devstack cinder-volume[71632]: import eventlet # noqa Apr 27 23:45:03 devstack cinder-volume[71632]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=71632) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 23:45:03 devstack cinder-volume[71632]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=71632) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 23:45:03 devstack cinder-volume[71632]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=71632) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 23:45:03 devstack cinder-volume[71632]: INFO dbcounter [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Registered counter for database cinder Apr 27 23:45:03 devstack cinder-volume[71632]: DEBUG oslo_db.sqlalchemy.engines [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71632) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:45:03 devstack cinder-volume[71632]: DEBUG dbcounter [-] [71632] Writer thread running {{(pid=71632) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 23:45:03 devstack cinder-volume[71632]: INFO cinder.rpc [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 27 23:45:03 devstack cinder-volume[71632]: INFO cinder.rpc [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 27 23:45:03 devstack cinder-volume[71632]: DEBUG oslo_db.sqlalchemy.engines [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71632) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:45:03 devstack cinder-volume[71632]: INFO cinder.volume.manager [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Determined volume DB was empty at startup. Apr 27 23:45:03 devstack cinder-volume[71632]: DEBUG cinder.volume.manager [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=71632) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 27 23:45:03 devstack cinder-volume[71632]: INFO cinder.volume.manager [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 27 23:45:03 devstack cinder-volume[71632]: WARNING stevedore.named [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 27 23:45:03 devstack cinder-volume[71632]: WARNING castellan.key_manager [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 23:45:03 devstack cinder-volume[71632]: WARNING cinder.keymgr.conf_key_mgr [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 23:45:03 devstack cinder-volume[71632]: DEBUG cinder.volume.drivers.lvm [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=71632) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 27 23:45:03 devstack cinder-volume[71632]: DEBUG oslo_concurrency.processutils [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=71632) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_concurrency.processutils [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] CMD "cinder-rtstool verify" returned: 0 in 0.239s {{(pid=71632) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_db.sqlalchemy.engines [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71632) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:45:04 devstack cinder-volume[71632]: INFO cinder.rpc [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 27 23:45:04 devstack cinder-volume[71632]: INFO cinder.rpc [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 27 23:45:04 devstack cinder-volume[71632]: WARNING stevedore.named [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 27 23:45:04 devstack cinder-volume[71632]: WARNING castellan.key_manager [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 23:45:04 devstack cinder-volume[71632]: INFO cinder.volume.manager [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_db.sqlalchemy.engines [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71632) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:45:04 devstack cinder-volume[71632]: INFO oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Starting 1 workers Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Started child 71742 {{(pid=71632) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Full set of CONF: {{(pid=71632) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] ******************************************************************************** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Configuration options gathered from: {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] ================================================================================ {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] allow_availability_zone_fallback = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] allow_compression_on_image_upload = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] allowed_direct_url_schemes = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] api_rate_limit = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] auth_strategy = keystone {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] az_cache_duration = 3600 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_availability_zone = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_host = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_stats_polling_interval = 60 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backup_api_class = cinder.backup.api.API {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backup_name_template = backup-%s {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backup_use_same_host = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backup_use_temp_snapshot = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] chap_password = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] chap_username = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cinder_internal_tenant_project_id = 7007413f976a41f68758d14bc2d729da {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cinder_internal_tenant_user_id = a98d1f08cb194a6b878ec653447d9615 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cloned_volume_same_az = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cluster = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] compression_format = gzip {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] compute_api_class = cinder.compute.nova.API {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] config_dir = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] config_source = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] control_exchange = openstack {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] debug = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] default_availability_zone = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] default_group_type = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] default_volume_type = lvmdriver-1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] disk_geometry = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] driver_client_cert = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] driver_client_cert_key = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] driver_data_namespace = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] driver_ssl_cert_path = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] driver_ssl_cert_verify = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] driver_use_ssl = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] enable_force_upload = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] enable_new_services = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] enable_unsupported_driver = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] enabled_backends = ['lvmdriver-1'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] enforce_multipath_for_image_xfer = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] filter_function = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_api_insecure = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_api_servers = ['http://192.168.122.161/image'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71742]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_api_ssl_compression = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_ca_certificates_file = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_catalog_info = image:glance:publicURL {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_certfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_keyfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_num_retries = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance_request_timeout = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] goodness_function = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] graceful_shutdown_timeout = 5 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] group_api_class = cinder.group.api.API {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] host = devstack {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_compress_on_upload = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_conversion_address_space_limit = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_conversion_cpu_limit = 60 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_conversion_disable = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_upload_use_cinder_backend = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_upload_use_internal_tenant = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_volume_cache_enabled = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_volume_cache_max_count = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] image_volume_cache_max_size_gb = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] init_host_max_objects_retrieval = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] instance_format = [instance: %(uuid)s] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] iscsi_target_flags = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] iscsi_write_cache = on {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] iser_helper = tgtadm {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] iser_ip_address = 192.168.122.161 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] iser_port = 3260 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] log_color = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] log_config_append = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] log_dir = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] log_file = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] log_options = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] log_rotate_interval = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] log_rotate_interval_type = days {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] log_rotation_type = none {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] max_age = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] max_logfile_count = 30 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] max_logfile_size_mb = 200 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] max_over_subscription_ratio = 20.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] message_reap_interval = 86400 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] message_ttl = 2592000 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] migration_create_volume_timeout_secs = 300 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] monkey_patch = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] monkey_patch_modules = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] my_ip = 192.168.122.161 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] no_snapshot_gb_quota = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] num_iser_scan_tries = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] num_shell_tries = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] num_volume_device_scan_tries = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] nvmeof_conn_info_version = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] nvmet_ns_id = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] nvmet_port_id = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] osapi_max_limit = 1000 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] osapi_volume_ext_list = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] osapi_volume_listen = 0.0.0.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] osapi_volume_listen_port = 8776 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] osapi_volume_use_ssl = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] osapi_volume_workers = 2 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] per_volume_size_limit = -1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] periodic_fuzzy_delay = 60 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] periodic_interval = 60 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] project_id_regex = [0-9a-f\-]+ {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] public_endpoint = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] publish_errors = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] quota_backup_gigabytes = 1000 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] quota_backups = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] quota_gigabytes = 1000 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] quota_groups = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71742]: INFO cinder.volume.manager [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 27 23:45:04 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] quota_snapshots = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] quota_volumes = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] rate_limit_burst = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] rate_limit_except_level = CRITICAL {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] rate_limit_interval = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] reinit_driver_count = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] replication_device = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] report_discard_supported = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] report_interval = 120 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] reservation_clean_interval = 86400 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] reservation_expire = 86400 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] reserved_image_namespaces = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] reserved_percentage = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] rpc_response_timeout = 120 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] run_external_periodic_tasks = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] scst_target_driver = iscsi {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] scst_target_iqn_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_down_time = 720 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] shell_completion = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] snapshot_name_template = snapshot-%s {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] snapshot_same_host = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] split_loggers = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] state_path = /opt/stack/data/cinder {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] storage_availability_zone = nova {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] storage_protocol = iSCSI {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] syslog_log_facility = LOG_USER {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] target_helper = lioadm {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] target_ip_address = 192.168.122.161 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] target_port = 3260 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] target_protocol = iscsi {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] target_secondary_ip_addresses = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] trace_flags = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] transfer_api_class = cinder.transfer.api.API {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] transport_url = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] until_refresh = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] use_chap_auth = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] use_default_quota_class = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] use_journal = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] use_json = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] use_multipath_for_image_xfer = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] use_stderr = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] use_syslog = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] verify_glance_signatures = enabled {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_api_class = cinder.volume.api.API {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_backend_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_clear = zero {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_clear_ionice = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_clear_size = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_copy_bps_limit = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_dd_blocksize = 1M {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_name_template = volume-%s {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_service_inithost_offload = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volume_usage_audit_period = month {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] zoning_mode = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_concurrency.disable_process_locking = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.admin_password = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.admin_tenant_name = admin {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.admin_token = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.admin_user = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.auth_admin_prefix = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.auth_port = 35357 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.auth_protocol = https {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.auth_section = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.auth_type = password {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.auth_uri = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.auth_version = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.cache = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.certfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.delay_auth_decision = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.http_connect_timeout = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.identity_uri = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.include_service_catalog = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.insecure = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.interface = public {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.keyfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_password = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcache_username = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.region_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.service_token_roles_required = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.service_type = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.token_cache_time = 300 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.161/identity {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.backend = dogpile.cache.null {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.backend_argument = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.backend_expiration_time = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.config_prefix = cache.oslo {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.debug_cache_backend = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.enable_retry_client = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.enable_socket_keepalive = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.enabled = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.enforce_fips_mode = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.expiration_time = 600 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.hashclient_dead_timeout = 60.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.hashclient_retry_attempts = 2 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.memcache_dead_retry = 300 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.memcache_pool_maxsize = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.memcache_sasl_enabled = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.memcache_servers = ['localhost:11211'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.password = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.proxies = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.redis_db = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.redis_sentinel_service_name = mymaster {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.redis_server = localhost:6379 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.retry_attempts = 2 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.retry_delay = 0.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.socket_keepalive_count = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.socket_keepalive_idle = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.socket_keepalive_interval = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.socket_timeout = 1.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.tls_allowed_ciphers = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.tls_cafile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.tls_certfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.tls_enabled = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.tls_keyfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cache.username = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] coordination.backend_url = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.asyncio_connection = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.asyncio_slave_connection = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.backend = sqlalchemy {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.connection = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.connection_debug = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.connection_parameters = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.connection_recycle_time = 3600 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.connection_trace = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.db_inc_retry_interval = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.db_max_retries = 20 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.db_max_retry_interval = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.db_retry_interval = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.max_overflow = 50 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.max_pool_size = 5 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.max_retries = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.mysql_sql_mode = TRADITIONAL {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.mysql_wsrep_sync_wait = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.pool_timeout = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.retry_interval = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.slave_connection = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.sqlite_synchronous = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.synchronous_reader = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] database.use_db_reconnect = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_metrics.metrics_process_name = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.connection_string = messaging:// {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.enabled = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.es_doc_type = notification {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.es_scroll_size = 10000 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.es_scroll_time = 2m {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.filter_error_trace = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.hmac_keys = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.sentinel_service_name = mymaster {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.socket_timeout = 0.1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.trace_requests = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler.trace_sqlalchemy = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler_jaeger.process_tags = {} {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler_jaeger.service_name_prefix = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] profiler_otlp.service_name_prefix = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.enforce_new_defaults = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: WARNING oslo_config.cfg [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.enforce_scope = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.policy_default_rule = default {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.policy_file = policy.yaml {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_policy.remote_timeout = 60.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] privsep_osbrick.capabilities = [21, 2] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] privsep_osbrick.group = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] privsep_osbrick.helper_command = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] privsep_osbrick.user = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cinder_sys_admin.group = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cinder_sys_admin.helper_command = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] cinder_sys_admin.user = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.auth_section = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.auth_type = password {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.cafile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.certfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.collect_timing = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.insecure = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.keyfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.send_service_user_token = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.split_loggers = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] service_user.timeout = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.auth_section = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.auth_type = password {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.certfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.collect_timing = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.insecure = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.keyfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.region_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.split_loggers = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] glance.timeout = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.backend_availability_zone = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.chap_password = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.chap_username = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.disk_geometry = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.driver_client_cert = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.driver_client_cert_key = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.driver_data_namespace = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.driver_use_ssl = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.enable_unsupported_driver = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.extra_capabilities = {} {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.filter_function = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.goodness_function = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.iscsi_target_flags = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.iscsi_write_cache = on {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.iser_helper = tgtadm {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.iser_ip_address = 192.168.122.161 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.iser_port = 3260 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.lvm_mirrors = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.lvm_share_target = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.lvm_type = auto {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.num_shell_tries = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.nvmet_ns_id = 10 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.nvmet_port_id = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.replication_device = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.report_discard_supported = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.reserved_percentage = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.scst_target_driver = iscsi {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.scst_target_iqn_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.storage_protocol = iSCSI {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.target_helper = tgtadm {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.target_ip_address = 192.168.122.161 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.target_port = 3260 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.target_protocol = iscsi {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.trace_flags = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.unique_fqdn_network = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.use_chap_auth = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volume_backend_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volume_clear = zero {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volume_clear_ionice = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volume_clear_size = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volume_group = cinder-volumes {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_reports.file_event_handler = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_reports.log_dir = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.backend_availability_zone = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.backend_host = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.chap_password = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.chap_username = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.chiscsi_conf = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.disk_geometry = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.driver_client_cert = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.driver_client_cert_key = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.driver_data_namespace = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.driver_use_ssl = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.extra_capabilities = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.filter_function = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.goodness_function = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.iscsi_target_flags = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.iscsi_write_cache = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.iser_helper = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.iser_ip_address = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.iser_port = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.iser_target_prefix = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.lvm_conf_file = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.lvm_mirrors = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.lvm_share_target = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.lvm_type = auto {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.num_shell_tries = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.nvmet_ns_id = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.nvmet_port_id = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.replication_device = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.report_discard_supported = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.reserved_percentage = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.scst_target_driver = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.storage_protocol = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.target_helper = lioadm {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.target_ip_address = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.target_port = 3260 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.target_protocol = iscsi {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.trace_flags = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.unique_fqdn_network = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.use_chap_auth = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volume_clear = zero {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volume_clear_ionice = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volume_clear_size = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] lvmdriver-1.volumes_dir = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.ssl = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.ssl_version = {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_notifications.driver = [] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_notifications.retry = -1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] oslo_messaging_notifications.transport_url = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] key_manager.fixed_key = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.barbican_api_version = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.barbican_endpoint = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.barbican_endpoint_type = public {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.barbican_region_name = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.cafile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.certfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.collect_timing = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.insecure = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.keyfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.number_of_retries = 60 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.retry_delay = 1 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.send_service_user_token = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.split_loggers = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.timeout = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.verify_ssl = True {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican.verify_ssl_path = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican_service_user.auth_section = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican_service_user.auth_type = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican_service_user.cafile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican_service_user.certfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican_service_user.collect_timing = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican_service_user.insecure = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican_service_user.keyfile = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican_service_user.split_loggers = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] barbican_service_user.timeout = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack sudo[71747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.approle_role_id = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.approle_secret_id = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.kv_mountpoint = secret {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.kv_path = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.kv_version = 2 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.namespace = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.root_token_id = **** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack sudo[71747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.ssl_ca_crt_file = None {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.timeout = 60.0 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.use_ssl = False {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:45:04 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] ******************************************************************************** {{(pid=71632) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 27 23:45:05 devstack sudo[71747]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:05 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.573s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:05 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:05 devstack sudo[71779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:45:05 devstack sudo[71779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:05 devstack sudo[71779]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:05 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.543s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:05 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:45:05 devstack cinder-volume[71742]: INFO cinder.brick.local_dev.lvm [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 27 23:45:05 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:05 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:05 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:05 devstack sudo[72016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 23:45:05 devstack sudo[72016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:06 devstack sudo[72016]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:06 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:06 devstack cinder-volume[71742]: DEBUG cinder.brick.local_dev.lvm [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=71742) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 27 23:45:06 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:06 devstack sudo[72219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:45:06 devstack sudo[72219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:07 devstack sudo[72219]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:07 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.183s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:07 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:07 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:07 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:07 devstack sudo[72375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:45:07 devstack sudo[72375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:07 devstack sudo[72375]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:07 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.586s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:07 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:07 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:07 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:07 devstack sudo[72438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 27 23:45:07 devstack sudo[72438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:08 devstack sudo[72438]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:08 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.454s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:08 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:08 devstack sudo[72444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 23:45:08 devstack sudo[72444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:08 devstack sudo[72444]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:08 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:08 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:08 devstack sudo[72449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 23:45:08 devstack sudo[72449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:09 devstack sudo[72449]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:09 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:09 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:09 devstack sudo[72452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:45:09 devstack sudo[72452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:09 devstack sudo[72452]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:09 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:09 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:09 devstack sudo[72457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:45:09 devstack sudo[72457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:10 devstack sudo[72457]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:10 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.528s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:10 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:10 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:10 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:10 devstack sudo[72464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:45:10 devstack sudo[72464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:10 devstack sudo[72464]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:10 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:10 devstack cinder-volume[71742]: INFO cinder.volume.drivers.lvm [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 27 23:45:10 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:10 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:10 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:10 devstack sudo[72474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:45:10 devstack sudo[72474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:11 devstack sudo[72474]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:11 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.610s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:11 devstack cinder-volume[71742]: DEBUG cinder.volume.drivers.lvm [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Updating volume stats {{(pid=71742) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 23:45:11 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:11 devstack sudo[72586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 23:45:11 devstack sudo[72586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:11 devstack sudo[72586]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:11 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:11 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:11 devstack sudo[72589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:45:11 devstack sudo[72589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:12 devstack sudo[72589]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:12 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:12 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:12 devstack sudo[72732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:45:12 devstack sudo[72732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:12 devstack sudo[72732]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:12 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:12 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:12 devstack sudo[72737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:45:12 devstack sudo[72737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:13 devstack sudo[72737]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:13 devstack cinder-volume[71742]: INFO cinder.volume.driver [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Driver hasn't implemented _init_vendor_properties() Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG cinder.volume.driver [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=71742) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG oslo_db.sqlalchemy.engines [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG dbcounter [-] [71742] Writer thread running {{(pid=71742) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG cinder.db.sqlalchemy.api [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Building query based on filter {{(pid=71742) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG cinder.image.image_utils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=71742) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 27 23:45:13 devstack cinder-volume[71742]: INFO cinder.keymgr.migration [None req-321a7f83-f9b1-4ca1-8e5e-d47c250d4fea None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG cinder.volume.drivers.lvm [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Updating volume stats {{(pid=71742) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:13 devstack sudo[72741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 23:45:13 devstack sudo[72741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:13 devstack sudo[72741]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:13 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:13 devstack sudo[72745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:45:13 devstack sudo[72745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:14 devstack cinder-volume[71632]: DEBUG dbcounter [-] [71632] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71632) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:45:14 devstack sudo[72745]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:14 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.524s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:14 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:14 devstack sudo[72749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:45:14 devstack sudo[72749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:14 devstack sudo[72749]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:14 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.477s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:14 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:14 devstack sudo[72762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:45:14 devstack sudo[72762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:15 devstack sudo[72762]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:15 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:15 devstack cinder-volume[71742]: DEBUG cinder.manager [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Notifying Schedulers of capabilities ... {{(pid=71742) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:45:15 devstack cinder-volume[71742]: INFO cinder.volume.manager [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Driver initialization completed successfully. Apr 27 23:45:15 devstack cinder-volume[71742]: INFO cinder.manager [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Initiating service 2 cleanup Apr 27 23:45:15 devstack cinder-volume[71742]: INFO cinder.manager [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Service 2 cleanup completed. Apr 27 23:45:15 devstack cinder-volume[71742]: DEBUG cinder.service [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Creating RPC server for service cinder-volume {{(pid=71742) start /opt/stack/cinder/cinder/service.py:231}} Apr 27 23:45:15 devstack cinder-volume[71742]: DEBUG cinder.service [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=71742) start /opt/stack/cinder/cinder/service.py:237}} Apr 27 23:45:15 devstack cinder-volume[71742]: INFO cinder.volume.manager [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 27 23:45:15 devstack cinder-volume[71742]: DEBUG cinder.volume.drivers.lvm [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Updating volume stats {{(pid=71742) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 23:45:15 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:15 devstack sudo[72766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 23:45:15 devstack sudo[72766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:16 devstack sudo[72766]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:16 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.544s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:16 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:16 devstack sudo[72770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:45:16 devstack sudo[72770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:16 devstack sudo[72770]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:16 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:16 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:16 devstack sudo[72773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:45:16 devstack sudo[72773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:16 devstack sudo[72773]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:16 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:16 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:45:17 devstack sudo[72809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:45:17 devstack sudo[72809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:45:17 devstack sudo[72809]: pam_unix(sudo:session): session closed for user root Apr 27 23:45:17 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:45:17 devstack cinder-volume[71742]: INFO cinder.volume.manager [None req-55118435-511d-486a-a78a-bab9e1c69d51 None None] Driver post RPC initialization completed successfully. Apr 27 23:45:27 devstack cinder-volume[71742]: DEBUG dbcounter [-] [71742] Writing DB stats cinder:SELECT=4 {{(pid=71742) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:45:27 devstack cinder-volume[71742]: DEBUG dbcounter [-] [71742] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=71742) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:46:25 devstack cinder-volume[71742]: DEBUG oslo_service.periodic_task [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71742) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:46:25 devstack cinder-volume[71742]: DEBUG cinder.volume.drivers.lvm [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Updating volume stats {{(pid=71742) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 23:46:25 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:46:25 devstack sudo[77558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 23:46:25 devstack sudo[77558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:46:25 devstack sudo[77558]: pam_unix(sudo:session): session closed for user root Apr 27 23:46:25 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:46:25 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:46:25 devstack sudo[77561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:46:25 devstack sudo[77561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:46:26 devstack sudo[77561]: pam_unix(sudo:session): session closed for user root Apr 27 23:46:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:46:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:46:26 devstack sudo[77564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:46:26 devstack sudo[77564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:46:26 devstack sudo[77564]: pam_unix(sudo:session): session closed for user root Apr 27 23:46:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:46:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:46:26 devstack sudo[77567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:46:26 devstack sudo[77567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:46:27 devstack sudo[77567]: pam_unix(sudo:session): session closed for user root Apr 27 23:46:27 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:46:27 devstack cinder-volume[71742]: DEBUG cinder.manager [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Notifying Schedulers of capabilities ... {{(pid=71742) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:47:25 devstack cinder-volume[71742]: DEBUG oslo_service.periodic_task [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71742) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:47:25 devstack cinder-volume[71742]: DEBUG cinder.volume.drivers.lvm [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Updating volume stats {{(pid=71742) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 23:47:25 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:47:25 devstack sudo[78696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 23:47:25 devstack sudo[78696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:47:25 devstack sudo[78696]: pam_unix(sudo:session): session closed for user root Apr 27 23:47:25 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:47:25 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:47:25 devstack sudo[78710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:47:25 devstack sudo[78710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:47:26 devstack sudo[78710]: pam_unix(sudo:session): session closed for user root Apr 27 23:47:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:47:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:47:26 devstack sudo[78736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:47:26 devstack sudo[78736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:47:26 devstack sudo[78736]: pam_unix(sudo:session): session closed for user root Apr 27 23:47:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.469s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:47:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:47:26 devstack sudo[78767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:47:26 devstack sudo[78767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:47:27 devstack sudo[78767]: pam_unix(sudo:session): session closed for user root Apr 27 23:47:27 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:47:27 devstack cinder-volume[71742]: DEBUG cinder.manager [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Notifying Schedulers of capabilities ... {{(pid=71742) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:47:27 devstack cinder-volume[71742]: DEBUG dbcounter [-] [71742] Writing DB stats cinder:SELECT=1 {{(pid=71742) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:47:27 devstack cinder-volume[71742]: DEBUG dbcounter [-] [71742] Writing DB stats cinder:UPDATE=1 {{(pid=71742) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:48:25 devstack cinder-volume[71742]: DEBUG oslo_service.periodic_task [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71742) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:48:25 devstack cinder-volume[71742]: DEBUG cinder.volume.drivers.lvm [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Updating volume stats {{(pid=71742) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 27 23:48:25 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:25 devstack sudo[80195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 27 23:48:25 devstack sudo[80195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:48:25 devstack sudo[80195]: pam_unix(sudo:session): session closed for user root Apr 27 23:48:25 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:25 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:25 devstack sudo[80217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:48:25 devstack sudo[80217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:48:26 devstack sudo[80217]: pam_unix(sudo:session): session closed for user root Apr 27 23:48:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:26 devstack sudo[80221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 27 23:48:26 devstack sudo[80221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:48:26 devstack sudo[80221]: pam_unix(sudo:session): session closed for user root Apr 27 23:48:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:26 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:26 devstack sudo[80225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 27 23:48:26 devstack sudo[80225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:48:27 devstack sudo[80225]: pam_unix(sudo:session): session closed for user root Apr 27 23:48:27 devstack cinder-volume[71742]: DEBUG oslo_concurrency.processutils [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=71742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:27 devstack cinder-volume[71742]: DEBUG cinder.manager [None req-90d77902-e072-4ec3-b287-9fe330c70403 None None] Notifying Schedulers of capabilities ... {{(pid=71742) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:48:42 devstack cinder-volume[71632]: INFO oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Caught SIGTERM, stopping children Apr 27 23:48:42 devstack cinder-volume[71632]: DEBUG oslo_concurrency.lockutils [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Acquiring lock "singleton_lock" {{(pid=71632) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 23:48:42 devstack cinder-volume[71632]: DEBUG oslo_concurrency.lockutils [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Acquired lock "singleton_lock" {{(pid=71632) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 23:48:42 devstack cinder-volume[71632]: DEBUG oslo_concurrency.lockutils [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Releasing lock "singleton_lock" {{(pid=71632) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 23:48:42 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Stop services. {{(pid=71632) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 27 23:48:42 devstack cinder-volume[71632]: DEBUG oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Killing children. {{(pid=71632) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 27 23:48:42 devstack cinder-volume[71632]: INFO oslo_service.backend._eventlet.service [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Waiting on 1 children to exit Apr 27 23:48:47 devstack cinder-volume[71742]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 27 23:48:47 devstack cinder-volume[80710]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 27 23:48:47 devstack cinder-volume[80710]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 23:48:47 devstack cinder-volume[80710]: we strongly recommend against using it for new projects. Apr 27 23:48:47 devstack cinder-volume[80710]: If you are already using Eventlet, we recommend migrating to a different Apr 27 23:48:47 devstack cinder-volume[80710]: framework. For more detail see Apr 27 23:48:47 devstack cinder-volume[80710]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 23:48:47 devstack cinder-volume[80710]: import eventlet # noqa Apr 27 23:48:49 devstack cinder-volume[80710]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80710) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 23:48:49 devstack cinder-volume[80710]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80710) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 23:48:49 devstack cinder-volume[80710]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80710) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 23:48:50 devstack cinder-volume[80710]: INFO dbcounter [None req-779b2714-1a95-476b-984e-08496905e17d None None] Registered counter for database cinder Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_db.sqlalchemy.engines [None req-779b2714-1a95-476b-984e-08496905e17d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:48:50 devstack cinder-volume[71742]: DEBUG oslo_concurrency.lockutils [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Acquiring lock "singleton_lock" {{(pid=71742) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 23:48:50 devstack cinder-volume[71742]: DEBUG oslo_concurrency.lockutils [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Acquired lock "singleton_lock" {{(pid=71742) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 23:48:50 devstack cinder-volume[71742]: DEBUG oslo_concurrency.lockutils [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Releasing lock "singleton_lock" {{(pid=71742) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 23:48:50 devstack cinder-volume[71742]: WARNING amqp [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 27 23:48:50 devstack cinder-volume[71742]: WARNING amqp [None req-a1a39844-a1ad-4f74-af8f-05c6912579ab None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG dbcounter [-] [80710] Writer thread running {{(pid=80710) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 23:48:50 devstack cinder-volume[80710]: INFO cinder.rpc [None req-779b2714-1a95-476b-984e-08496905e17d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 27 23:48:50 devstack cinder-volume[80710]: INFO cinder.rpc [None req-779b2714-1a95-476b-984e-08496905e17d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_db.sqlalchemy.engines [None req-779b2714-1a95-476b-984e-08496905e17d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:48:50 devstack cinder-volume[80710]: INFO cinder.volume.manager [None req-779b2714-1a95-476b-984e-08496905e17d None None] Determined volume DB was empty at startup. Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG cinder.volume.manager [None req-779b2714-1a95-476b-984e-08496905e17d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80710) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 27 23:48:50 devstack cinder-volume[80710]: INFO cinder.volume.manager [None req-779b2714-1a95-476b-984e-08496905e17d None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 27 23:48:50 devstack cinder-volume[80710]: WARNING stevedore.named [None req-779b2714-1a95-476b-984e-08496905e17d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 27 23:48:50 devstack cinder-volume[80710]: WARNING castellan.key_manager [None req-779b2714-1a95-476b-984e-08496905e17d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 23:48:50 devstack cinder-volume[80710]: WARNING cinder.keymgr.conf_key_mgr [None req-779b2714-1a95-476b-984e-08496905e17d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 23:48:50 devstack cinder-volume[80710]: INFO cinder.volume.manager [None req-779b2714-1a95-476b-984e-08496905e17d None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_db.sqlalchemy.engines [None req-779b2714-1a95-476b-984e-08496905e17d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:48:50 devstack cinder-volume[80710]: INFO oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] Starting 1 workers Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] Started child 80825 {{(pid=80710) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] Full set of CONF: {{(pid=80710) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] ******************************************************************************** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] Configuration options gathered from: {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] ================================================================================ {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] allow_availability_zone_fallback = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] allow_compression_on_image_upload = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] allowed_direct_url_schemes = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] api_rate_limit = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] auth_strategy = keystone {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_availability_zone = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_host = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_stats_polling_interval = 60 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backup_api_class = cinder.backup.api.API {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backup_name_template = backup-%s {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backup_use_same_host = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backup_use_temp_snapshot = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] chap_password = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] chap_username = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cinder_internal_tenant_project_id = 7007413f976a41f68758d14bc2d729da {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cinder_internal_tenant_user_id = a98d1f08cb194a6b878ec653447d9615 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cluster = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] compression_format = gzip {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] compute_api_class = cinder.compute.nova.API {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] config_dir = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] config_source = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] control_exchange = openstack {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] debug = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] default_availability_zone = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] default_group_type = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] default_volume_type = QuobyteHD {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] disk_geometry = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] driver_client_cert = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] driver_client_cert_key = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] driver_data_namespace = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] driver_ssl_cert_path = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] driver_ssl_cert_verify = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80825]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] driver_use_ssl = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] enable_new_services = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] enable_unsupported_driver = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] enabled_backends = ['QuobyteHD'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] enforce_multipath_for_image_xfer = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] filter_function = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_api_insecure = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_api_servers = ['http://192.168.122.161/image'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_api_ssl_compression = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_ca_certificates_file = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_catalog_info = image:glance:publicURL {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_certfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_keyfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_num_retries = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance_request_timeout = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] goodness_function = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] graceful_shutdown_timeout = 5 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] group_api_class = cinder.group.api.API {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] host = devstack {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_compress_on_upload = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_conversion_address_space_limit = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_conversion_cpu_limit = 60 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_conversion_disable = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_upload_use_cinder_backend = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_upload_use_internal_tenant = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_volume_cache_enabled = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_volume_cache_max_count = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] image_volume_cache_max_size_gb = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] init_host_max_objects_retrieval = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] instance_format = [instance: %(uuid)s] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] iscsi_target_flags = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] iscsi_write_cache = on {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] iser_helper = tgtadm {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] iser_ip_address = 192.168.122.161 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] iser_port = 3260 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] log_color = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] log_config_append = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] log_dir = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] log_file = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] log_options = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] log_rotate_interval = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] log_rotate_interval_type = days {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] log_rotation_type = none {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] max_age = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] max_logfile_count = 30 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] max_logfile_size_mb = 200 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] max_over_subscription_ratio = 20.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] message_reap_interval = 86400 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] message_ttl = 2592000 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] migration_create_volume_timeout_secs = 300 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] monkey_patch = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] monkey_patch_modules = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] my_ip = 192.168.122.161 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] no_snapshot_gb_quota = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] num_iser_scan_tries = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] num_shell_tries = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] num_volume_device_scan_tries = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] nvmeof_conn_info_version = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] nvmet_ns_id = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] nvmet_port_id = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] osapi_max_limit = 1000 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] osapi_volume_ext_list = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] osapi_volume_listen = 0.0.0.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] osapi_volume_listen_port = 8776 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] osapi_volume_use_ssl = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] osapi_volume_workers = 2 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] per_volume_size_limit = -1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] periodic_fuzzy_delay = 60 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] periodic_interval = 60 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] project_id_regex = [0-9a-f\-]+ {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] public_endpoint = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] publish_errors = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] quota_backup_gigabytes = 1000 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] quota_backups = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] quota_gigabytes = 1000 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] quota_groups = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] quota_snapshots = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] quota_volumes = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] rate_limit_burst = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] rate_limit_except_level = CRITICAL {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] rate_limit_interval = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] reinit_driver_count = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] replication_device = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] report_discard_supported = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] report_interval = 120 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] reservation_clean_interval = 86400 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] reservation_expire = 86400 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] reserved_image_namespaces = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] reserved_percentage = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] rpc_response_timeout = 120 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] run_external_periodic_tasks = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] scst_target_driver = iscsi {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] scst_target_iqn_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_down_time = 720 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] shell_completion = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] snapshot_name_template = snapshot-%s {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] split_loggers = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] state_path = /opt/stack/data/cinder {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] storage_availability_zone = nova {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] storage_protocol = iSCSI {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] syslog_log_facility = LOG_USER {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] target_helper = lioadm {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] target_ip_address = 192.168.122.161 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] target_port = 3260 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] target_protocol = iscsi {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] target_secondary_ip_addresses = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] trace_flags = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] transfer_api_class = cinder.transfer.api.API {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] transport_url = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] until_refresh = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] use_chap_auth = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] use_default_quota_class = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] use_journal = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] use_json = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] use_multipath_for_image_xfer = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] use_stderr = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] use_syslog = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] verify_glance_signatures = enabled {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_api_class = cinder.volume.api.API {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_backend_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_clear = zero {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_clear_ionice = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_clear_size = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_copy_bps_limit = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_dd_blocksize = 1M {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_name_template = volume-%s {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_service_inithost_offload = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volume_usage_audit_period = month {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] zoning_mode = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_concurrency.disable_process_locking = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.admin_password = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.admin_token = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.admin_user = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.auth_admin_prefix = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.auth_port = 35357 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.auth_protocol = https {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.auth_section = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.auth_type = password {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.auth_uri = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.auth_version = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.cache = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.certfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.delay_auth_decision = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.http_connect_timeout = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.identity_uri = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.include_service_catalog = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.insecure = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.interface = public {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.keyfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_password = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80825]: INFO cinder.volume.manager [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.remotefs [None req-486d025c-f754-448f-906b-b3060ad69869 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=80825) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcache_username = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.region_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.service_token_roles_required = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.service_type = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.token_cache_time = 300 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.161/identity {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.backend = dogpile.cache.null {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.backend_argument = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.backend_expiration_time = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.config_prefix = cache.oslo {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.debug_cache_backend = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.enable_retry_client = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.enable_socket_keepalive = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.enabled = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.enforce_fips_mode = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.expiration_time = 600 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.hashclient_retry_attempts = 2 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.memcache_dead_retry = 300 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.memcache_pool_maxsize = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.memcache_sasl_enabled = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.password = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.proxies = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.redis_db = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.redis_sentinel_service_name = mymaster {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.redis_server = localhost:6379 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.retry_attempts = 2 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.retry_delay = 0.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.socket_keepalive_count = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.socket_keepalive_idle = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.socket_keepalive_interval = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.socket_timeout = 1.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.tls_allowed_ciphers = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.tls_cafile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.tls_certfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.tls_enabled = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.tls_keyfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cache.username = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] coordination.backend_url = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.asyncio_connection = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.asyncio_slave_connection = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.backend = sqlalchemy {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.connection = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.connection_debug = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.connection_parameters = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.connection_recycle_time = 3600 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.connection_trace = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.db_inc_retry_interval = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.db_max_retries = 20 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.db_max_retry_interval = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.db_retry_interval = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.max_overflow = 50 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.max_pool_size = 5 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.max_retries = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.mysql_wsrep_sync_wait = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.pool_timeout = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.retry_interval = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.slave_connection = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.sqlite_synchronous = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.synchronous_reader = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] database.use_db_reconnect = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.connection_string = messaging:// {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.enabled = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.es_doc_type = notification {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.es_scroll_size = 10000 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.es_scroll_time = 2m {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.filter_error_trace = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.hmac_keys = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.sentinel_service_name = mymaster {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.socket_timeout = 0.1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.trace_requests = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler.trace_sqlalchemy = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler_jaeger.process_tags = {} {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler_jaeger.service_name_prefix = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] profiler_otlp.service_name_prefix = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.enforce_new_defaults = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: WARNING oslo_config.cfg [None req-779b2714-1a95-476b-984e-08496905e17d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.enforce_scope = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.policy_default_rule = default {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.policy_file = policy.yaml {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_policy.remote_timeout = 60.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] privsep_osbrick.group = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] privsep_osbrick.helper_command = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] privsep_osbrick.user = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cinder_sys_admin.group = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cinder_sys_admin.helper_command = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] cinder_sys_admin.user = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.auth_section = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.auth_type = password {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.cafile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.certfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.collect_timing = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.insecure = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.keyfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.send_service_user_token = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.split_loggers = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] service_user.timeout = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.auth_section = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.auth_type = password {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.certfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.collect_timing = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.insecure = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.keyfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.region_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.split_loggers = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] glance.timeout = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.backend_availability_zone = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.chap_password = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.chap_username = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.disk_geometry = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.driver_client_cert = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.driver_client_cert_key = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.driver_data_namespace = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.driver_use_ssl = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.enable_unsupported_driver = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.extra_capabilities = {} {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.filter_function = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.goodness_function = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.iscsi_target_flags = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.iscsi_write_cache = on {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.iser_helper = tgtadm {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.iser_ip_address = 192.168.122.161 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.iser_port = 3260 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_host = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_login = admin {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_mount_options = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_password = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_private_key = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_share_path = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_ssh_port = 22 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.num_shell_tries = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.nvmet_port_id = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.quobyte_client_cfg = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.quobyte_volume_url = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.replication_device = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.report_discard_supported = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.reserved_percentage = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.scst_target_driver = iscsi {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.scst_target_iqn_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.storage_protocol = iSCSI {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.target_helper = tgtadm {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.target_ip_address = 192.168.122.161 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.target_port = 3260 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.target_protocol = iscsi {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.trace_flags = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.unique_fqdn_network = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.use_chap_auth = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.volume_backend_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.volume_clear = zero {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.volume_clear_ionice = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.volume_clear_size = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_reports.file_event_handler = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_reports.log_dir = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.backend_availability_zone = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.backend_host = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.chap_password = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.chap_username = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.chiscsi_conf = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.disk_geometry = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.driver_client_cert = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.driver_client_cert_key = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.driver_data_namespace = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.driver_use_ssl = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.extra_capabilities = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.filter_function = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.goodness_function = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.iscsi_target_flags = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.iscsi_write_cache = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.iser_helper = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.iser_ip_address = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.iser_port = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.iser_target_prefix = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_host = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_login = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_mount_options = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_password = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_private_key = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_share_path = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_ssh_port = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.num_shell_tries = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nvmet_ns_id = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.nvmet_port_id = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.replication_device = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.report_discard_supported = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.reserved_percentage = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.scst_target_driver = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.storage_protocol = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.target_helper = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.target_ip_address = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.target_port = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.target_prefix = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.target_protocol = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.trace_flags = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.unique_fqdn_network = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.use_chap_auth = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.volume_clear = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.volume_clear_ionice = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.volume_clear_size = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] QuobyteHD.volumes_dir = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.ssl = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=80825) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 27 23:48:50 devstack cinder-volume[80825]: WARNING cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80825]: WARNING cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.ssl_version = {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_notifications.driver = [] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_notifications.retry = -1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] oslo_messaging_notifications.transport_url = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] key_manager.fixed_key = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.barbican_api_version = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.barbican_endpoint = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.barbican_endpoint_type = public {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.barbican_region_name = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.cafile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.certfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.collect_timing = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.insecure = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.keyfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.number_of_retries = 60 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.retry_delay = 1 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.send_service_user_token = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.split_loggers = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.timeout = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.verify_ssl = True {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Running cmd (subprocess): mount.quobyte {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican.verify_ssl_path = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican_service_user.auth_section = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican_service_user.auth_type = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican_service_user.cafile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican_service_user.certfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican_service_user.collect_timing = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:50 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican_service_user.insecure = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican_service_user.keyfile = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican_service_user.split_loggers = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] barbican_service_user.timeout = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.approle_role_id = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.approle_secret_id = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.kv_mountpoint = secret {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.kv_path = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.kv_version = 2 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.namespace = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.root_token_id = **** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.ssl_ca_crt_file = None {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.timeout = 60.0 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.use_ssl = False {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:48:51 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] ******************************************************************************** {{(pid=80710) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 27 23:48:51 devstack quobyte-client[80829]: Reading configuration file: /etc/quobyte/client.cfg Apr 27 23:48:51 devstack quobyte-client[80829]: Invalid parameters found, error: missing mount point. Apr 27 23:48:51 devstack quobyte-client[80829]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 27 23:48:51 devstack quobyte-client[80829]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=80825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:48:51 devstack cinder-volume[80825]: INFO cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 ... Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 -c /etc/quobyte/client-cinder.cfg {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:51 devstack sudo[80830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 -c /etc/quobyte/client-cinder.cfg Apr 27 23:48:51 devstack sudo[80830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:48:51 devstack sudo[80830]: pam_unix(sudo:session): session closed for user root Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.516s {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:51 devstack cinder-volume[80825]: INFO cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 succeeded Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=80825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.525s {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:51 devstack sudo[80899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:48:51 devstack sudo[80899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:48:51 devstack sudo[80899]: pam_unix(sudo:session): session closed for user root Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.408s {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:51 devstack cinder-volume[80825]: INFO cinder.volume.driver [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Driver hasn't implemented _init_vendor_properties() Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG cinder.volume.driver [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80825) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 27 23:48:51 devstack cinder-volume[80825]: DEBUG oslo_db.sqlalchemy.engines [None req-486d025c-f754-448f-906b-b3060ad69869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80825) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG dbcounter [-] [80825] Writer thread running {{(pid=80825) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG cinder.db.sqlalchemy.api [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Building query based on filter {{(pid=80825) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG cinder.image.image_utils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80825) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 27 23:48:52 devstack cinder-volume[80825]: INFO cinder.keymgr.migration [None req-92130c17-9ec0-4da7-a0e0-413f0c8fc8b0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=80825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=80825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:52 devstack sudo[80902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:48:52 devstack sudo[80902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:48:52 devstack sudo[80902]: pam_unix(sudo:session): session closed for user root Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.425s {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG cinder.manager [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Notifying Schedulers of capabilities ... {{(pid=80825) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:48:52 devstack cinder-volume[80825]: INFO cinder.volume.manager [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Driver initialization completed successfully. Apr 27 23:48:52 devstack cinder-volume[80825]: INFO cinder.manager [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Initiating service 3 cleanup Apr 27 23:48:52 devstack cinder-volume[80825]: INFO cinder.manager [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Service 3 cleanup completed. Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG cinder.service [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Creating RPC server for service cinder-volume {{(pid=80825) start /opt/stack/cinder/cinder/service.py:231}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG cinder.service [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80825) start /opt/stack/cinder/cinder/service.py:237}} Apr 27 23:48:52 devstack cinder-volume[80825]: INFO cinder.volume.manager [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=80825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.quobyte [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=80825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:48:52 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:52 devstack sudo[80908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:48:52 devstack sudo[80908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:48:53 devstack sudo[80908]: pam_unix(sudo:session): session closed for user root Apr 27 23:48:53 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-486d025c-f754-448f-906b-b3060ad69869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.428s {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:53 devstack cinder-volume[80825]: INFO cinder.volume.manager [None req-486d025c-f754-448f-906b-b3060ad69869 None None] Driver post RPC initialization completed successfully. Apr 27 23:48:56 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-405696a3-deb0-4bd9-a2b8-7048d0981981 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:48:56 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-405696a3-deb0-4bd9-a2b8-7048d0981981 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:48:56 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.quobyte [None req-405696a3-deb0-4bd9-a2b8-7048d0981981 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=80825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:48:56 devstack cinder-volume[80825]: DEBUG cinder.volume.drivers.quobyte [None req-405696a3-deb0-4bd9-a2b8-7048d0981981 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=80825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:48:56 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-405696a3-deb0-4bd9-a2b8-7048d0981981 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=80825) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:48:56 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-405696a3-deb0-4bd9-a2b8-7048d0981981 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:48:56 devstack sudo[80972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:48:56 devstack sudo[80972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:48:56 devstack sudo[80972]: pam_unix(sudo:session): session closed for user root Apr 27 23:48:56 devstack cinder-volume[80825]: DEBUG oslo_concurrency.processutils [None req-405696a3-deb0-4bd9-a2b8-7048d0981981 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.406s {{(pid=80825) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:48:56 devstack cinder-volume[80825]: DEBUG cinder.manager [None req-405696a3-deb0-4bd9-a2b8-7048d0981981 None None] Notifying Schedulers of capabilities ... {{(pid=80825) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:48:58 devstack cinder-volume[80710]: INFO oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] Caught SIGTERM, stopping children Apr 27 23:48:58 devstack cinder-volume[80710]: DEBUG oslo_concurrency.lockutils [None req-779b2714-1a95-476b-984e-08496905e17d None None] Acquiring lock "singleton_lock" {{(pid=80710) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 23:48:58 devstack cinder-volume[80710]: DEBUG oslo_concurrency.lockutils [None req-779b2714-1a95-476b-984e-08496905e17d None None] Acquired lock "singleton_lock" {{(pid=80710) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 23:48:58 devstack cinder-volume[80710]: DEBUG oslo_concurrency.lockutils [None req-779b2714-1a95-476b-984e-08496905e17d None None] Releasing lock "singleton_lock" {{(pid=80710) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 23:48:58 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] Stop services. {{(pid=80710) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 27 23:48:58 devstack cinder-volume[80710]: DEBUG oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] Killing children. {{(pid=80710) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 27 23:48:58 devstack cinder-volume[80710]: INFO oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] Waiting on 1 children to exit Apr 27 23:49:00 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-779b2714-1a95-476b-984e-08496905e17d None None] Acquiring lock "singleton_lock" {{(pid=80825) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 23:49:00 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-779b2714-1a95-476b-984e-08496905e17d None None] Acquired lock "singleton_lock" {{(pid=80825) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 23:49:00 devstack cinder-volume[80825]: DEBUG oslo_concurrency.lockutils [None req-779b2714-1a95-476b-984e-08496905e17d None None] Releasing lock "singleton_lock" {{(pid=80825) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 23:49:00 devstack cinder-volume[80825]: WARNING amqp [None req-779b2714-1a95-476b-984e-08496905e17d None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 27 23:49:00 devstack cinder-volume[80825]: WARNING amqp [None req-779b2714-1a95-476b-984e-08496905e17d None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 27 23:49:00 devstack cinder-volume[80710]: INFO oslo_service.backend._eventlet.service [None req-779b2714-1a95-476b-984e-08496905e17d None None] Child 80825 exited with status 0 Apr 27 23:49:01 devstack cinder-volume[81058]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 27 23:49:01 devstack cinder-volume[81058]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 23:49:01 devstack cinder-volume[81058]: we strongly recommend against using it for new projects. Apr 27 23:49:01 devstack cinder-volume[81058]: If you are already using Eventlet, we recommend migrating to a different Apr 27 23:49:01 devstack cinder-volume[81058]: framework. For more detail see Apr 27 23:49:01 devstack cinder-volume[81058]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 23:49:01 devstack cinder-volume[81058]: import eventlet # noqa Apr 27 23:49:03 devstack cinder-volume[81058]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81058) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 27 23:49:03 devstack cinder-volume[81058]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81058) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 27 23:49:03 devstack cinder-volume[81058]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81058) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 27 23:49:03 devstack cinder-volume[81058]: INFO dbcounter [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Registered counter for database cinder Apr 27 23:49:03 devstack cinder-volume[81058]: DEBUG oslo_db.sqlalchemy.engines [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81058) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG dbcounter [-] [81058] Writer thread running {{(pid=81058) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 23:49:04 devstack cinder-volume[81058]: INFO cinder.rpc [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 27 23:49:04 devstack cinder-volume[81058]: INFO cinder.rpc [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_db.sqlalchemy.engines [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81058) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:49:04 devstack cinder-volume[81058]: INFO cinder.volume.manager [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Determined volume DB was empty at startup. Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG cinder.volume.manager [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81058) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 27 23:49:04 devstack cinder-volume[81058]: WARNING stevedore.named [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 27 23:49:04 devstack cinder-volume[81058]: WARNING castellan.key_manager [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 23:49:04 devstack cinder-volume[81058]: WARNING cinder.keymgr.conf_key_mgr [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 27 23:49:04 devstack cinder-volume[81058]: INFO cinder.volume.manager [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_db.sqlalchemy.engines [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81058) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:49:04 devstack cinder-volume[81058]: INFO oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Starting 1 workers Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Started child 81312 {{(pid=81058) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Full set of CONF: {{(pid=81058) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] ******************************************************************************** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Configuration options gathered from: {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] ================================================================================ {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] allow_availability_zone_fallback = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] allow_compression_on_image_upload = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] allowed_direct_url_schemes = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] api_rate_limit = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] auth_strategy = keystone {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_availability_zone = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_host = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_stats_polling_interval = 60 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81312]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backup_api_class = cinder.backup.api.API {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backup_name_template = backup-%s {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backup_use_same_host = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backup_use_temp_snapshot = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] chap_password = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] chap_username = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cinder_internal_tenant_project_id = 7007413f976a41f68758d14bc2d729da {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cinder_internal_tenant_user_id = a98d1f08cb194a6b878ec653447d9615 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cluster = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] compression_format = gzip {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] compute_api_class = cinder.compute.nova.API {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] config_dir = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] config_source = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] control_exchange = openstack {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] debug = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] default_availability_zone = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] default_group_type = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] default_volume_type = QuobyteHD {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] disk_geometry = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] driver_client_cert = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] driver_client_cert_key = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] driver_data_namespace = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] driver_ssl_cert_path = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] driver_ssl_cert_verify = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] driver_use_ssl = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] enable_new_services = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] enable_unsupported_driver = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] enabled_backends = ['QuobyteHD'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] enforce_multipath_for_image_xfer = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] filter_function = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_api_insecure = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_api_servers = ['http://192.168.122.161/image'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_api_ssl_compression = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_ca_certificates_file = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_catalog_info = image:glance:publicURL {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_certfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_keyfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_num_retries = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance_request_timeout = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] goodness_function = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] graceful_shutdown_timeout = 5 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] group_api_class = cinder.group.api.API {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] host = devstack {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_compress_on_upload = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_conversion_address_space_limit = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_conversion_cpu_limit = 60 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_conversion_disable = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_upload_use_cinder_backend = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_upload_use_internal_tenant = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_volume_cache_enabled = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_volume_cache_max_count = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] image_volume_cache_max_size_gb = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] init_host_max_objects_retrieval = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] instance_format = [instance: %(uuid)s] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] iscsi_target_flags = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] iscsi_write_cache = on {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] iser_helper = tgtadm {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] iser_ip_address = 192.168.122.161 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] iser_port = 3260 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] log_color = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] log_config_append = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] log_dir = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] log_file = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] log_options = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] log_rotate_interval = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] log_rotate_interval_type = days {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] log_rotation_type = none {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack sudo[81316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] max_age = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] max_logfile_count = 30 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] max_logfile_size_mb = 200 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] max_over_subscription_ratio = 20.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] message_reap_interval = 86400 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] message_ttl = 2592000 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] migration_create_volume_timeout_secs = 300 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack sudo[81316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] monkey_patch = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] monkey_patch_modules = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] my_ip = 192.168.122.161 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] no_snapshot_gb_quota = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] num_iser_scan_tries = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] num_shell_tries = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] num_volume_device_scan_tries = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] nvmeof_conn_info_version = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] nvmet_ns_id = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] nvmet_port_id = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] osapi_max_limit = 1000 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] osapi_volume_ext_list = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] osapi_volume_listen_port = 8776 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] osapi_volume_use_ssl = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] osapi_volume_workers = 2 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] per_volume_size_limit = -1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] periodic_fuzzy_delay = 60 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] periodic_interval = 60 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] public_endpoint = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] publish_errors = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] quota_backup_gigabytes = 1000 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] quota_backups = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] quota_gigabytes = 1000 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] quota_groups = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] quota_snapshots = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] quota_volumes = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] rate_limit_burst = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] rate_limit_except_level = CRITICAL {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] rate_limit_interval = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] reinit_driver_count = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] replication_device = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] report_discard_supported = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] report_interval = 120 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] reservation_clean_interval = 86400 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] reservation_expire = 86400 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] reserved_image_namespaces = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] reserved_percentage = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] rpc_response_timeout = 120 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] run_external_periodic_tasks = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] scst_target_driver = iscsi {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] scst_target_iqn_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_down_time = 720 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] shell_completion = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] snapshot_name_template = snapshot-%s {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] split_loggers = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] state_path = /opt/stack/data/cinder {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] storage_availability_zone = nova {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] storage_protocol = iSCSI {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] syslog_log_facility = LOG_USER {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] target_helper = lioadm {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] target_ip_address = 192.168.122.161 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] target_port = 3260 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] target_protocol = iscsi {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] target_secondary_ip_addresses = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] trace_flags = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] transport_url = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] until_refresh = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] use_chap_auth = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] use_default_quota_class = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] use_journal = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] use_json = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] use_multipath_for_image_xfer = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] use_stderr = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] use_syslog = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] verify_glance_signatures = enabled {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_api_class = cinder.volume.api.API {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_backend_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_clear = zero {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_clear_ionice = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_clear_size = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_copy_bps_limit = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_dd_blocksize = 1M {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_name_template = volume-%s {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_service_inithost_offload = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volume_usage_audit_period = month {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] zoning_mode = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_concurrency.disable_process_locking = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.admin_password = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.admin_token = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.admin_user = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.auth_port = 35357 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.auth_protocol = https {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.auth_section = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.auth_type = password {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.auth_uri = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.auth_version = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.cache = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.certfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.identity_uri = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.include_service_catalog = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.insecure = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.interface = public {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.keyfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_password = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81312) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcache_username = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.region_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.service_type = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.161/identity {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.backend = dogpile.cache.null {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.backend_argument = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.backend_expiration_time = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.config_prefix = cache.oslo {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.debug_cache_backend = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.enable_retry_client = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.enable_socket_keepalive = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.enabled = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.enforce_fips_mode = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.expiration_time = 600 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.hashclient_retry_attempts = 2 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.memcache_dead_retry = 300 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.memcache_pool_maxsize = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.memcache_sasl_enabled = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.password = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.proxies = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.redis_db = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.redis_server = localhost:6379 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.retry_attempts = 2 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.retry_delay = 0.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.socket_keepalive_count = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.socket_keepalive_idle = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.socket_keepalive_interval = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.socket_timeout = 1.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.tls_allowed_ciphers = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.tls_cafile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.tls_certfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.tls_enabled = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.tls_keyfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cache.username = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] coordination.backend_url = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.asyncio_connection = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.asyncio_slave_connection = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.backend = sqlalchemy {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.connection = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.connection_debug = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.connection_parameters = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.connection_recycle_time = 3600 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.connection_trace = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.db_inc_retry_interval = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.db_max_retries = 20 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.db_max_retry_interval = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.db_retry_interval = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.max_overflow = 50 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.max_pool_size = 5 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.max_retries = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.mysql_wsrep_sync_wait = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.pool_timeout = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.retry_interval = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.slave_connection = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.sqlite_synchronous = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.synchronous_reader = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] database.use_db_reconnect = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.connection_string = messaging:// {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.enabled = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.es_doc_type = notification {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.es_scroll_size = 10000 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.es_scroll_time = 2m {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.filter_error_trace = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.hmac_keys = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.sentinel_service_name = mymaster {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.socket_timeout = 0.1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.trace_requests = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler.trace_sqlalchemy = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler_jaeger.process_tags = {} {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler_jaeger.service_name_prefix = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] profiler_otlp.service_name_prefix = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.enforce_new_defaults = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: WARNING oslo_config.cfg [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.enforce_scope = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.policy_default_rule = default {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.policy_file = policy.yaml {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] privsep_osbrick.group = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] privsep_osbrick.helper_command = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] privsep_osbrick.user = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cinder_sys_admin.group = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cinder_sys_admin.helper_command = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] cinder_sys_admin.user = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.auth_section = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.auth_type = password {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.cafile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.certfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.collect_timing = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.insecure = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.keyfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.send_service_user_token = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.split_loggers = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] service_user.timeout = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.auth_section = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.auth_type = password {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.certfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.collect_timing = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.insecure = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.keyfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.region_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.split_loggers = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] glance.timeout = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.backend_availability_zone = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.chap_password = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.chap_username = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.disk_geometry = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.driver_client_cert = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.driver_client_cert_key = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.driver_data_namespace = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.driver_use_ssl = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.extra_capabilities = {} {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.filter_function = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.goodness_function = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.iscsi_target_flags = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.iscsi_write_cache = on {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.iser_helper = tgtadm {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.iser_ip_address = 192.168.122.161 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.iser_port = 3260 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_host = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_login = admin {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_mount_options = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_password = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_private_key = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_share_path = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.num_shell_tries = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.quobyte_volume_url = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.replication_device = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.report_discard_supported = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.reserved_percentage = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.target_helper = tgtadm {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.target_ip_address = 192.168.122.161 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.target_port = 3260 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.target_protocol = iscsi {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.trace_flags = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.unique_fqdn_network = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.use_chap_auth = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.volume_backend_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.volume_clear = zero {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.volume_clear_ionice = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.volume_clear_size = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_reports.file_event_handler = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_reports.log_dir = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.backend_availability_zone = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.backend_host = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81312) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 27 23:49:04 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.quobyte [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.chap_password = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.chap_username = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.quobyte [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.chiscsi_conf = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.disk_geometry = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.driver_client_cert = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.driver_data_namespace = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Running cmd (subprocess): mount.quobyte {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.driver_use_ssl = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.extra_capabilities = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.filter_function = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.goodness_function = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.iser_helper = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.iser_ip_address = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.iser_port = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.iser_target_prefix = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_host = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_login = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_mount_options = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_password = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_private_key = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_share_path = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_ssh_port = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.num_shell_tries = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.nvmet_port_id = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.replication_device = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.report_discard_supported = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.reserved_percentage = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.scst_target_driver = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.storage_protocol = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.target_helper = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.target_ip_address = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.target_port = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.target_prefix = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.target_protocol = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.trace_flags = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.use_chap_auth = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.volume_clear = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.volume_clear_size = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] QuobyteHD.volumes_dir = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.ssl = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_notifications.driver = [] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_notifications.retry = -1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] key_manager.fixed_key = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.barbican_api_version = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.barbican_endpoint = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.barbican_endpoint_type = public {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.barbican_region_name = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.cafile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.certfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.collect_timing = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.insecure = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.keyfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.number_of_retries = 60 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.retry_delay = 1 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.send_service_user_token = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.split_loggers = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.timeout = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.verify_ssl = True {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican.verify_ssl_path = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican_service_user.auth_section = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican_service_user.auth_type = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican_service_user.cafile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican_service_user.certfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican_service_user.collect_timing = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican_service_user.insecure = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican_service_user.keyfile = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican_service_user.split_loggers = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] barbican_service_user.timeout = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.approle_role_id = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.approle_secret_id = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.kv_mountpoint = secret {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.kv_path = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.kv_version = 2 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.namespace = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.root_token_id = **** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.ssl_ca_crt_file = None {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.timeout = 60.0 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.use_ssl = False {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 27 23:49:04 devstack cinder-volume[81058]: DEBUG oslo_service.backend._eventlet.service [None req-03f5f07c-af48-409a-b442-c1b33394f715 None None] ******************************************************************************** {{(pid=81058) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:49:04 devstack sudo[81316]: pam_unix(sudo:session): session closed for user root Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.524s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:49:04 devstack cinder-volume[81312]: INFO cinder.volume.driver [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Driver hasn't implemented _init_vendor_properties() Apr 27 23:49:04 devstack cinder-volume[81312]: DEBUG cinder.volume.driver [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81312) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_db.sqlalchemy.engines [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81312) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writer thread running {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG cinder.db.sqlalchemy.api [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Building query based on filter {{(pid=81312) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81312) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:49:05 devstack cinder-volume[81312]: INFO cinder.keymgr.migration [None req-e114f142-7f95-421e-985b-af957678313a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 27 23:49:05 devstack sudo[81330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:49:05 devstack sudo[81330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:49:05 devstack sudo[81330]: pam_unix(sudo:session): session closed for user root Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.411s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:49:05 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Driver initialization completed successfully. Apr 27 23:49:05 devstack cinder-volume[81312]: INFO cinder.manager [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Initiating service 3 cleanup Apr 27 23:49:05 devstack cinder-volume[81312]: INFO cinder.manager [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Service 3 cleanup completed. Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG cinder.service [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Creating RPC server for service cinder-volume {{(pid=81312) start /opt/stack/cinder/cinder/service.py:231}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG cinder.service [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81312) start /opt/stack/cinder/cinder/service.py:237}} Apr 27 23:49:05 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:49:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:49:05 devstack sudo[81336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:49:05 devstack sudo[81336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:49:06 devstack sudo[81336]: pam_unix(sudo:session): session closed for user root Apr 27 23:49:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.419s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:49:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cd424e34-c93a-4451-bafe-38482b6e8929 None None] Driver post RPC initialization completed successfully. Apr 27 23:49:14 devstack cinder-volume[81058]: DEBUG dbcounter [-] [81058] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81058) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:49:15 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:49:16 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=3 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:50:03 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Flow 'volume_create_manager' (df8b4c64-1007-4ac3-82bc-a7fa28dd4430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f989699-901f-40fe-accc-703d87e8ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f989699-901f-40fe-accc-703d87e8ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-722464549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5258af0d-92c3-4295-855d-6c60e2c485a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55fcb326e64a4bf3993d5fda2b113b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:04Z,use_quota=True,user_id='fcd9ad4cf1874490a58fe9b2f1e3e6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc6f313-c3bc-42ef-93a9-472ce5f27f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc6f313-c3bc-42ef-93a9-472ce5f27f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3db739-deb6-41a2-b945-608e1a40be00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3db739-deb6-41a2-b945-608e1a40be00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5258af0d-92c3-4295-855d-6c60e2c485a2', 'volume_name': 'volume-5258af0d-92c3-4295-855d-6c60e2c485a2', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1204638c-bf55-4cc6-b734-343563cf839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1204638c-bf55-4cc6-b734-343563cf839e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057957ab-c7d1-46fb-8a04-12f6d1b35e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:04 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Volume 5258af0d-92c3-4295-855d-6c60e2c485a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5258af0d-92c3-4295-855d-6c60e2c485a2', 'volume_size': 1} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-722464549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5258af0d-92c3-4295-855d-6c60e2c485a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55fcb326e64a4bf3993d5fda2b113b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:04Z,use_quota=True,user_id='fcd9ad4cf1874490a58fe9b2f1e3e6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Creating volume 5258af0d-92c3-4295-855d-6c60e2c485a2 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:50:04 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:50:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:04 devstack sudo[81751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2 1073741824 Apr 27 23:50:04 devstack sudo[81751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:05 devstack sudo[81751]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2 1073741824" returned: 0 in 0.872s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:05 devstack sudo[82114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2 Apr 27 23:50:05 devstack sudo[82114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:05 devstack sudo[82114]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2" returned: 0 in 0.522s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:50:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057957ab-c7d1-46fb-8a04-12f6d1b35e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5258af0d-92c3-4295-855d-6c60e2c485a2', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096e7b28-0493-40df-96d6-4e99e8fdb93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:05 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Volume volume-5258af0d-92c3-4295-855d-6c60e2c485a2 (5258af0d-92c3-4295-855d-6c60e2c485a2): created successfully Apr 27 23:50:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096e7b28-0493-40df-96d6-4e99e8fdb93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Flow 'volume_create_manager' (df8b4c64-1007-4ac3-82bc-a7fa28dd4430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:05 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-ea1c64f2-2525-4248-8183-b28052ebfbca req-a3feb5c6-6c7b-4ffc-bbc6-bcf3c3b145f3 tempest-VolumesGetTestJSON-108953416 None] Created volume successfully. Apr 27 23:50:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Acquiring lock "cinder-5258af0d-92c3-4295-855d-6c60e2c485a2-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:50:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Lock "cinder-5258af0d-92c3-4295-855d-6c60e2c485a2-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:50:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Acquiring lock "cinder-quobyte-5258af0d-92c3-4295-855d-6c60e2c485a2" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:50:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Lock "cinder-quobyte-5258af0d-92c3-4295-855d-6c60e2c485a2" acquired by "delete_volume" :: waited 0.030s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:50:06 devstack cinder-volume[81312]: INFO oslo.privsep.daemon [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9ak0bug8/privsep.sock'] Apr 27 23:50:06 devstack sudo[82144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9ak0bug8/privsep.sock Apr 27 23:50:06 devstack sudo[82144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:07 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 27 23:50:07 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 23:50:07 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 27 23:50:07 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: Apr 27 23:50:07 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 27 23:50:07 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 27 23:50:07 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 23:50:07 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: Apr 27 23:50:07 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 27 23:50:08 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 27 23:50:08 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 27 23:50:08 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 27 23:50:08 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: Apr 27 23:50:08 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 27 23:50:08 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 27 23:50:08 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 27 23:50:08 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: Apr 27 23:50:08 devstack cinder-volume[81312]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 27 23:50:08 devstack sudo[82144]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:08 devstack cinder-volume[81312]: INFO oslo.privsep.daemon [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Spawned new privsep daemon via rootwrap Apr 27 23:50:08 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Accepted privsep connection to /tmp/tmp9ak0bug8/privsep.sock {{(pid=81312) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 27 23:50:08 devstack cinder-volume[81312]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 27 23:50:08 devstack cinder-volume[81312]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 27 23:50:08 devstack cinder-volume[81312]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 27 23:50:08 devstack cinder-volume[81312]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82167 Apr 27 23:50:08 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e31bfd9-b560-4ad5-be05-e61a6804f357]: (2,) {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:50:08 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7070b9d7-fc4d-46ec-9874-981e2f89b6de]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:50:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:08 devstack sudo[82169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2 Apr 27 23:50:08 devstack sudo[82169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:09 devstack sudo[82169]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2" returned: 0 in 0.658s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:09 devstack sudo[82175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2 Apr 27 23:50:09 devstack sudo[82175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:09 devstack sudo[82175]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5258af0d-92c3-4295-855d-6c60e2c485a2" returned: 0 in 0.548s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Lock "cinder-quobyte-5258af0d-92c3-4295-855d-6c60e2c485a2" released by "delete_volume" :: held 3.093s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:50:09 devstack cinder-volume[81312]: WARNING cinder.quota [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:50:09 devstack cinder-volume[81312]: WARNING cinder.quota [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:50:09 devstack cinder-volume[81312]: DEBUG cinder.quota [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Created reservations ['43140792-83c0-4eea-899d-25296b51d433', 'dab409ac-6e34-4500-b9e4-f76a4f0cfb31', '2773eaac-732b-41cf-a214-0997df235245', 'ada7f7f1-a151-48cb-a7df-5bcb253245e3'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:50:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:10 devstack sudo[82182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:50:10 devstack sudo[82182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:10 devstack sudo[82182]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.570s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:10 devstack cinder-volume[81312]: DEBUG cinder.manager [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:50:10 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Deleted volume successfully. Apr 27 23:50:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-7e01fd51-f98a-40cf-8e55-9a23d2b64b1a req-20a924ec-2ffe-4c61-af12-1301d50cd0a6 tempest-VolumesGetTestJSON-108953416 None] Lock "cinder-5258af0d-92c3-4295-855d-6c60e2c485a2-delete_volume" released by "delete_volume" :: held 4.096s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Flow 'volume_create_manager' (eaf0bf93-f110-4439-b132-1080971b7335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9b8998-e72e-4ff8-8f68-3375572d73f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9b8998-e72e-4ff8-8f68-3375572d73f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:50:16Z,deleted=False,deleted_at=None,display_description='',display_name='eadf4b5f-b66c-4221-bcf5-4c2e5ddcb72e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d602e579-efd7-446c-9325-18e0e96913a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdae3515d93d4d13a83def5e53742a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:17Z,use_quota=True,user_id='894bb64f14424ff4b256cbd2313c4224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced17c57-9758-46be-919c-330276efcf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced17c57-9758-46be-919c-330276efcf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c42ecd5-a185-4c70-b788-2d7ab19fd670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c42ecd5-a185-4c70-b788-2d7ab19fd670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd602e579-efd7-446c-9325-18e0e96913a4', 'volume_name': 'volume-d602e579-efd7-446c-9325-18e0e96913a4', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93472f62-92a8-4dc1-bc35-c599a1f7d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93472f62-92a8-4dc1-bc35-c599a1f7d827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a15eb61-b916-4ba2-b1b9-9d23c9d2b105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:16 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Volume d602e579-efd7-446c-9325-18e0e96913a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d602e579-efd7-446c-9325-18e0e96913a4', 'volume_size': 1} Apr 27 23:50:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:50:16Z,deleted=False,deleted_at=None,display_description='',display_name='eadf4b5f-b66c-4221-bcf5-4c2e5ddcb72e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d602e579-efd7-446c-9325-18e0e96913a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdae3515d93d4d13a83def5e53742a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:17Z,use_quota=True,user_id='894bb64f14424ff4b256cbd2313c4224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Creating volume d602e579-efd7-446c-9325-18e0e96913a4 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:50:17 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:50:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:17 devstack sudo[82205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 1073741824 Apr 27 23:50:17 devstack sudo[82205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:18 devstack sudo[82205]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 1073741824" returned: 0 in 1.400s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:18 devstack sudo[82213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 Apr 27 23:50:18 devstack sudo[82213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:19 devstack sudo[82213]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4" returned: 0 in 0.763s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.251s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a15eb61-b916-4ba2-b1b9-9d23c9d2b105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d602e579-efd7-446c-9325-18e0e96913a4', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf5c5fd-e0fd-4f73-a69f-5fc7ad90240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:19 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Volume volume-d602e579-efd7-446c-9325-18e0e96913a4 (d602e579-efd7-446c-9325-18e0e96913a4): created successfully Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf5c5fd-e0fd-4f73-a69f-5fc7ad90240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Flow 'volume_create_manager' (eaf0bf93-f110-4439-b132-1080971b7335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:19 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-a80a144b-6153-43b7-ad1c-5743898ec821 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Created volume successfully. Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Flow 'volume_create_manager' (cb3733ba-eadd-4d43-b566-750a4d6fdd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28767a14-ea07-40ce-a9c9-8c517890d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28767a14-ea07-40ce-a9c9-8c517890d31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1811998028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88f3181-e6ff-426d-9694-879839dd03ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3654746b1fe4b57a1b692c934dfd678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:20Z,use_quota=True,user_id='a078a8dc625f4add8df22bff606bf89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca70ae3c-7bbc-4432-8080-9c9fc7c484ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca70ae3c-7bbc-4432-8080-9c9fc7c484ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9409527-a422-4f4d-a022-7fb575a8b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9409527-a422-4f4d-a022-7fb575a8b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd88f3181-e6ff-426d-9694-879839dd03ee', 'volume_name': 'volume-d88f3181-e6ff-426d-9694-879839dd03ee', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4f98f3-f5be-4843-8773-5f189e6d6926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4f98f3-f5be-4843-8773-5f189e6d6926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbf8cb7-2295-4265-9f9b-d9955598dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:19 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Volume d88f3181-e6ff-426d-9694-879839dd03ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d88f3181-e6ff-426d-9694-879839dd03ee', 'volume_size': 1} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1811998028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88f3181-e6ff-426d-9694-879839dd03ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3654746b1fe4b57a1b692c934dfd678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:20Z,use_quota=True,user_id='a078a8dc625f4add8df22bff606bf89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Creating volume d88f3181-e6ff-426d-9694-879839dd03ee {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:50:20 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:50:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:20 devstack sudo[82216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee 1073741824 Apr 27 23:50:20 devstack sudo[82216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:21 devstack sudo[82216]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee 1073741824" returned: 0 in 1.279s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:21 devstack sudo[82229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee Apr 27 23:50:21 devstack sudo[82229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-96d0d1a8-4122-4e1a-9b2a-95bdca1fa63d tempest-BackendsCapabilitiesAdminTestsJSON-1498371292 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81312) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 27 23:50:22 devstack sudo[82229]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee" returned: 0 in 0.678s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbf8cb7-2295-4265-9f9b-d9955598dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d88f3181-e6ff-426d-9694-879839dd03ee', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7217d90a-f006-45ad-911c-3f72f1bda638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:22 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Volume volume-d88f3181-e6ff-426d-9694-879839dd03ee (d88f3181-e6ff-426d-9694-879839dd03ee): created successfully Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7217d90a-f006-45ad-911c-3f72f1bda638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Flow 'volume_create_manager' (cb3733ba-eadd-4d43-b566-750a4d6fdd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:22 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d08d709a-511b-4791-8bfd-37b8caab0d99 tempest-VolumesAdminNegativeTest-1094878982 None] Created volume successfully. Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8c8977a1-f781-4105-81ab-d9b410b9dd0b tempest-BackendsCapabilitiesAdminTestsJSON-1498371292 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81312) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 27 23:50:22 devstack cinder-volume[81312]: WARNING py.warnings [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-40ccec86-b798-493c-9550-5b4bf48c8e08 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 27 23:50:22 devstack cinder-volume[81312]: .first() Apr 27 23:50:22 devstack cinder-volume[81312]: Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-40ccec86-b798-493c-9550-5b4bf48c8e08 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-40ccec86-b798-493c-9550-5b4bf48c8e08 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[920f2425-6382-432d-9ab4-dbe8e9a90461]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:50:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-40ccec86-b798-493c-9550-5b4bf48c8e08 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:22 devstack sudo[82244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 Apr 27 23:50:22 devstack sudo[82244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:23 devstack sudo[82244]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-40ccec86-b798-493c-9550-5b4bf48c8e08 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4" returned: 0 in 0.845s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-40ccec86-b798-493c-9550-5b4bf48c8e08 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-40ccec86-b798-493c-9550-5b4bf48c8e08 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6', 'name': 'volume-d602e579-efd7-446c-9325-18e0e96913a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94aba7cc-2e6a-40a1-bf10-013b0c132f41', 'enforce_multipath': True} {{(pid=81312) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 27 23:50:23 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-a891fd2a-4c3d-4d93-9b0b-14f151690d13 req-40ccec86-b798-493c-9550-5b4bf48c8e08 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] attachment_update completed successfully. Apr 27 23:50:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Acquiring lock "cinder-d88f3181-e6ff-426d-9694-879839dd03ee-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:50:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "cinder-d88f3181-e6ff-426d-9694-879839dd03ee-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:50:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Acquiring lock "cinder-quobyte-d88f3181-e6ff-426d-9694-879839dd03ee" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:50:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "cinder-quobyte-d88f3181-e6ff-426d-9694-879839dd03ee" acquired by "delete_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:50:24 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae74d4be-7e73-4abd-8856-5cb3abd11082]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:50:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:24 devstack sudo[82249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee Apr 27 23:50:24 devstack sudo[82249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:24 devstack sudo[82249]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee" returned: 0 in 0.754s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:24 devstack sudo[82255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee Apr 27 23:50:24 devstack sudo[82255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:25 devstack sudo[82255]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d88f3181-e6ff-426d-9694-879839dd03ee" returned: 0 in 0.717s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:25 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "cinder-quobyte-d88f3181-e6ff-426d-9694-879839dd03ee" released by "delete_volume" :: held 1.520s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:50:25 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Created reservations ['18bd5833-fe5b-4748-9cab-bd0da60f0629', 'f7dcfc5c-e7c1-48c9-a9aa-a5b487b6dec5', '3ccdec49-110b-46ce-a4eb-139e987d6121', '1994e97d-09cf-4769-a10e-5953074c7d75'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:50:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:25 devstack sudo[82259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:50:25 devstack sudo[82259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:26 devstack sudo[82259]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.942s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:26 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:50:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Deleted volume successfully. Apr 27 23:50:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce023a15-5a9e-4f77-8f6d-68c7cc87d8a9 tempest-VolumesAdminNegativeTest-1094878982 None] Lock "cinder-d88f3181-e6ff-426d-9694-879839dd03ee-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:50:29 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7fafad22-5b40-4350-b12a-da389664473c tempest-GroupSnapshotsV319Test-1447639184 None] Group tempest-GroupSnapshotsV319Test-Group-1123158763: creating Apr 27 23:50:30 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7fafad22-5b40-4350-b12a-da389664473c tempest-GroupSnapshotsV319Test-1447639184 None] Group tempest-GroupSnapshotsV319Test-Group-1123158763: created successfully Apr 27 23:50:30 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7fafad22-5b40-4350-b12a-da389664473c tempest-GroupSnapshotsV319Test-1447639184 None] Create group completed successfully. Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Flow 'volume_create_manager' (8ba68d9d-10cb-4fbe-8d6b-847c6dc5a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f115dcd9-f229-4347-be05-360be28223a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f115dcd9-f229-4347-be05-360be28223a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-502500553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9969f3af-29a0-4621-aa46-2a477c21285b,host='devstack@QuobyteHD#QuobyteHD',id=321070ef-5dc3-43ad-bcd2-90b2a8d41a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acce3515315e497fba620fba2167fb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:32Z,use_quota=True,user_id='2fd9206937274797b4d5f66d88e8d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ed1ada5-735e-48e4-8352-fa157e703e96),volume_type_id=3ed1ada5-735e-48e4-8352-fa157e703e96)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be66c3d-98b0-416b-be00-b1124ac014a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be66c3d-98b0-416b-be00-b1124ac014a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa62e8c7-7886-4531-b755-92ae4140b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa62e8c7-7886-4531-b755-92ae4140b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321070ef-5dc3-43ad-bcd2-90b2a8d41a16', 'volume_name': 'volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd32396-b9ea-4a8e-9581-47101df43a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd32396-b9ea-4a8e-9581-47101df43a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12979a52-7360-4218-9024-1c458e3e1232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:31 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Volume 321070ef-5dc3-43ad-bcd2-90b2a8d41a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16', 'volume_size': 1} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9969f3af-29a0-4621-aa46-2a477c21285b,created_at=2026-04-27T21:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-502500553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9969f3af-29a0-4621-aa46-2a477c21285b,host='devstack@QuobyteHD#QuobyteHD',id=321070ef-5dc3-43ad-bcd2-90b2a8d41a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acce3515315e497fba620fba2167fb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:32Z,use_quota=True,user_id='2fd9206937274797b4d5f66d88e8d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ed1ada5-735e-48e4-8352-fa157e703e96),volume_type_id=3ed1ada5-735e-48e4-8352-fa157e703e96)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Creating volume 321070ef-5dc3-43ad-bcd2-90b2a8d41a16 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:50:31 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:50:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:31 devstack sudo[82733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 1073741824 Apr 27 23:50:31 devstack sudo[82733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:32 devstack sudo[82733]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 1073741824" returned: 0 in 0.911s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:32 devstack sudo[82739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 Apr 27 23:50:32 devstack sudo[82739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:33 devstack sudo[82739]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" returned: 0 in 0.518s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:50:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12979a52-7360-4218-9024-1c458e3e1232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3cc248-ecba-4a9a-a747-881561bca5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:33 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Volume volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 (321070ef-5dc3-43ad-bcd2-90b2a8d41a16): created successfully Apr 27 23:50:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3cc248-ecba-4a9a-a747-881561bca5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Flow 'volume_create_manager' (8ba68d9d-10cb-4fbe-8d6b-847c6dc5a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:33 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-11133231-ff52-41b1-bbc4-c2f66f12a981 tempest-GroupSnapshotsV319Test-1447639184 None] Created volume successfully. Apr 27 23:50:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] GroupSnapshot 6f3ee1f3-dfa5-4ec1-ba8f-74a020d75746: creating. Apr 27 23:50:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Group snapshot 6f3ee1f3-dfa5-4ec1-ba8f-74a020d75746: creating. {{(pid=81312) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 27 23:50:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Creating offline snapshot ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd of volume 321070ef-5dc3-43ad-bcd2-90b2a8d41a16 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:50:34 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[40036de5-763b-4fff-9308-3ea7aa8fb836]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:50:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:34 devstack sudo[82746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 Apr 27 23:50:34 devstack sudo[82746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:35 devstack sudo[82746]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" returned: 0 in 0.743s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:35 devstack sudo[82783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd 1G Apr 27 23:50:35 devstack sudo[82783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:35 devstack sudo[82783]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd 1G" returned: 0 in 0.836s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:35 devstack sudo[82793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd Apr 27 23:50:35 devstack sudo[82793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:36 devstack sudo[82793]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd" returned: 0 in 0.688s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:36 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:50:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:36 devstack sudo[82802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd Apr 27 23:50:36 devstack sudo[82802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:37 devstack sudo[82802]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd" returned: 0 in 0.641s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:37 devstack sudo[82808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.info Apr 27 23:50:37 devstack sudo[82808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:37 devstack sudo[82808]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.info" returned: 0 in 0.538s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:37 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:50:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:37 devstack sudo[82813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.info Apr 27 23:50:37 devstack sudo[82813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:38 devstack sudo[82813]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.info" returned: 0 in 0.554s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.106s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:38 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-31da28bd-694b-4de2-84d6-d3e623beed82 tempest-GroupSnapshotsV319Test-1447639184 None] group_snapshot 6f3ee1f3-dfa5-4ec1-ba8f-74a020d75746: created successfully Apr 27 23:50:40 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] group_snapshot 6f3ee1f3-dfa5-4ec1-ba8f-74a020d75746: deleting Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] group_snapshot 6f3ee1f3-dfa5-4ec1-ba8f-74a020d75746: deleting {{(pid=81312) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Acquiring lock "cinder-quobyte-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "cinder-quobyte-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Acquiring lock "cinder-quobyte-ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "cinder-quobyte-ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Deleting offline snapshot ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd of volume 321070ef-5dc3-43ad-bcd2-90b2a8d41a16 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] snapshot_file for this snap is: volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9953d2-7d34-4712-97d6-13134249e340]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:40 devstack sudo[82819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd Apr 27 23:50:40 devstack sudo[82819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:40 devstack sudo[82819]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd" returned: 0 in 0.619s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[84199d32-7b30-452d-9237-cf6ca4aefa4d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:50:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:40 devstack sudo[82833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 Apr 27 23:50:40 devstack sudo[82833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:41 devstack sudo[82833]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" returned: 0 in 0.727s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:41 devstack sudo[82856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd Apr 27 23:50:41 devstack sudo[82856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:42 devstack sudo[82856]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd" returned: 0 in 0.813s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:42 devstack sudo[82861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd Apr 27 23:50:42 devstack sudo[82861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:43 devstack sudo[82861]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16.ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd" returned: 0 in 0.650s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "cinder-quobyte-ff8d3d49-fb65-47db-8bda-9d4eafb2fdfd" released by "_delete_snapshot" :: held 2.931s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:50:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "cinder-quobyte-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" released by "delete_snapshot" :: held 2.959s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:50:43 devstack cinder-volume[81312]: WARNING cinder.quota [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1218137921 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1218137921, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:50:43 devstack cinder-volume[81312]: WARNING cinder.quota [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1218137921 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1218137921, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:50:43 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] Created reservations ['c2884c52-cb85-4cfd-8cfe-2ba0021839e5', '93180fba-a740-4102-bcfe-8839ab7dabbf', 'd6496aee-bc13-4bf3-be9a-874d48fbc848', 'f412c823-5dd3-4cbd-8547-adf91080bd8d'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:50:43 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3f39070a-a104-49d1-aa7d-67244ec41703 tempest-GroupSnapshotsV319Test-1447639184 None] group_snapshot 6f3ee1f3-dfa5-4ec1-ba8f-74a020d75746: deleted successfully Apr 27 23:50:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Acquiring lock "cinder-quobyte-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:50:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "cinder-quobyte-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" acquired by "delete_volume" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:50:43 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da52f61-7445-4f51-85a0-afac97ce3a33]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:50:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:44 devstack sudo[82902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 Apr 27 23:50:44 devstack sudo[82902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:44 devstack sudo[82902]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" returned: 0 in 0.662s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:44 devstack sudo[82908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16 Apr 27 23:50:44 devstack sudo[82908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" returned: 0 in 0.481s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:45 devstack sudo[82908]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:45 devstack sudo[82911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:50:45 devstack sudo[82911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "cinder-quobyte-321070ef-5dc3-43ad-bcd2-90b2a8d41a16" released by "delete_volume" :: held 1.227s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Created reservations ['c1deb536-051b-41da-92c9-fdf9f75db378'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:50:45 devstack cinder-volume[81312]: WARNING cinder.quota [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1218137921 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1218137921, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Created reservations ['58f811ce-1e95-4bc8-b7d4-20bd08099d5c', 'f88ea5d3-312a-45f7-a4c5-cf5e9a85ea6c', '820de5a5-89d6-4c09-ad73-03d3d17f68fe', '98df480f-d5d7-4cc6-8e8a-048fa1e965f8'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:45 devstack sudo[82914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:50:45 devstack sudo[82914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:45 devstack sudo[82911]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.608s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:50:45 devstack sudo[82914]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.571s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:50:45 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5346bd54-75cb-4b80-8333-10f47fab0549 tempest-GroupSnapshotsV319Test-1447639184 None] Delete group completed successfully. Apr 27 23:50:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6eefe871-07f5-4fe4-ac47-1182192813b5 tempest-GroupsV320Test-795916614 None] Group tempest-GroupsV320Test-Group-1619112837: creating Apr 27 23:50:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6eefe871-07f5-4fe4-ac47-1182192813b5 tempest-GroupsV320Test-795916614 None] Group tempest-GroupsV320Test-Group-1619112837: created successfully Apr 27 23:50:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6eefe871-07f5-4fe4-ac47-1182192813b5 tempest-GroupsV320Test-795916614 None] Create group completed successfully. Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Flow 'volume_create_manager' (6c0d5047-c743-4d01-ba60-42f1e2c6a922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b722e8-a393-4648-a158-6fae0bc925e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=50,cinder:UPDATE=58,cinder:DELETE=4,cinder:INSERT=8 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b722e8-a393-4648-a158-6fae0bc925e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1242974241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8991a87a-9916-4203-8476-e83be48c94e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22603d4ebec54c6a9dedf36c8af44465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:55Z,use_quota=True,user_id='d8fc19e8641348a18333ee26bf2b54cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d11f41-cd15-4eb1-96c2-d2873cec59de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d11f41-cd15-4eb1-96c2-d2873cec59de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936cfd03-5e1e-4676-b3d8-d47665d62e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936cfd03-5e1e-4676-b3d8-d47665d62e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8991a87a-9916-4203-8476-e83be48c94e7', 'volume_name': 'volume-8991a87a-9916-4203-8476-e83be48c94e7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a2c4aa-75d0-414a-aaf9-52404c3329cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a2c4aa-75d0-414a-aaf9-52404c3329cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1a11d0-1629-4678-8e00-d1fdff08d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:55 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Volume 8991a87a-9916-4203-8476-e83be48c94e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8991a87a-9916-4203-8476-e83be48c94e7', 'volume_size': 1} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1242974241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8991a87a-9916-4203-8476-e83be48c94e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22603d4ebec54c6a9dedf36c8af44465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:55Z,use_quota=True,user_id='d8fc19e8641348a18333ee26bf2b54cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Creating volume 8991a87a-9916-4203-8476-e83be48c94e7 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:50:55 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:50:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:55 devstack sudo[83056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 1073741824 Apr 27 23:50:55 devstack sudo[83056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] Created reservations ['ee151ccf-0ef2-4a75-abdc-e3e00f8e8393'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:UPDATE=46,cinder:SELECT=54,cinder:INSERT=15,cinder:DELETE=2 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:56 devstack sudo[83058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:50:56 devstack sudo[83058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Flow 'volume_create_manager' (de13245b-0f72-4492-a7ae-01dc644ee1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd00746-5cf7-492e-8867-b8fb5f385520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd00746-5cf7-492e-8867-b8fb5f385520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-368590818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7630a9-cf59-4488-a7c0-8ecea3f31d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f829e43a47624371b535219ff58ddde1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:57Z,use_quota=True,user_id='d1187bee36354f518143f295f6f88c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9fe41e-01f0-49df-b3cb-616d7c081c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9fe41e-01f0-49df-b3cb-616d7c081c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489d9926-85ce-4de3-930e-2cfe20532064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489d9926-85ce-4de3-930e-2cfe20532064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7630a9-cf59-4488-a7c0-8ecea3f31d9e', 'volume_name': 'volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57af3c43-04b6-4765-98e8-70e529349232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57af3c43-04b6-4765-98e8-70e529349232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873c8c69-1604-4145-a520-bb846c02983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:56 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Volume 6b7630a9-cf59-4488-a7c0-8ecea3f31d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e', 'volume_size': 1} Apr 27 23:50:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:57 devstack sudo[83056]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 1073741824" returned: 0 in 1.711s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:57 devstack sudo[83064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 Apr 27 23:50:57 devstack sudo[83064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:57 devstack sudo[83058]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.550s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:57 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:50:57 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-43488051-2e60-485b-bfcf-e08bfea660df tempest-GroupsV320Test-795916614 None] Delete group completed successfully. Apr 27 23:50:58 devstack sudo[83064]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7" returned: 0 in 0.645s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] <== create_volume: return (2422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-368590818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7630a9-cf59-4488-a7c0-8ecea3f31d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f829e43a47624371b535219ff58ddde1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:50:57Z,use_quota=True,user_id='d1187bee36354f518143f295f6f88c4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Creating volume 6b7630a9-cf59-4488-a7c0-8ecea3f31d9e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:50:58 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1a11d0-1629-4678-8e00-d1fdff08d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8991a87a-9916-4203-8476-e83be48c94e7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e1f7ab-0ed9-4cb7-bf2f-2fe6f802d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:50:58 devstack sudo[83068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e 1073741824 Apr 27 23:50:58 devstack sudo[83068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:50:58 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Volume volume-8991a87a-9916-4203-8476-e83be48c94e7 (8991a87a-9916-4203-8476-e83be48c94e7): created successfully Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e1f7ab-0ed9-4cb7-bf2f-2fe6f802d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:50:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Flow 'volume_create_manager' (6c0d5047-c743-4d01-ba60-42f1e2c6a922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:50:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-835cc95c-d448-4364-ab49-87ac63f8193c tempest-DeleteServersTestJSON-1813792938 None] Created volume successfully. Apr 27 23:50:59 devstack sudo[83068]: pam_unix(sudo:session): session closed for user root Apr 27 23:50:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e 1073741824" returned: 0 in 1.249s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:50:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:50:59 devstack sudo[83108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e Apr 27 23:50:59 devstack sudo[83108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:00 devstack sudo[83108]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" returned: 0 in 0.682s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:51:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873c8c69-1604-4145-a520-bb846c02983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7254322-0bc4-40d0-8eba-aa0d57c61049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:00 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Volume volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e (6b7630a9-cf59-4488-a7c0-8ecea3f31d9e): created successfully Apr 27 23:51:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7254322-0bc4-40d0-8eba-aa0d57c61049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Flow 'volume_create_manager' (de13245b-0f72-4492-a7ae-01dc644ee1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-8a1ebd9e-2407-488f-a58d-99f54b02b14d req-43cdc6ff-e10c-487e-a69e-1f67cf4fcd0b tempest-VolumesSnapshotsTestJSON-1587579459 None] Created volume successfully. Apr 27 23:51:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Creating offline snapshot ff44ad54-a994-45bc-a8e9-cff78f177565 of volume 6b7630a9-cf59-4488-a7c0-8ecea3f31d9e {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:51:01 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b01c8-a87a-4fa7-8874-55866fbbf6b6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:01 devstack sudo[83125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e Apr 27 23:51:01 devstack sudo[83125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:02 devstack sudo[83125]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" returned: 0 in 1.495s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:02 devstack sudo[83161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 1G Apr 27 23:51:02 devstack sudo[83161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-e560a8ce-453d-4841-8d09-d0e1d1eedaaf req-5a719e2b-60b5-4bc4-bef3-858be4d02375 tempest-DeleteServersTestJSON-1813792938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:04 devstack sudo[83161]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 1G" returned: 0 in 1.402s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:04 devstack sudo[83176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 Apr 27 23:51:04 devstack sudo[83176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:04 devstack sudo[83176]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565" returned: 0 in 0.717s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:04 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 is being set with open permissions: ugo+rw Apr 27 23:51:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:04 devstack sudo[83181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 Apr 27 23:51:04 devstack sudo[83181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:05 devstack sudo[83181]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565" returned: 0 in 0.705s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:05 devstack sudo[83189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.info Apr 27 23:51:05 devstack sudo[83189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:06 devstack sudo[83189]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.info" returned: 0 in 0.641s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:06 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.info is being set with open permissions: ugo+rw Apr 27 23:51:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:06 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.info Apr 27 23:51:06 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:06 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.info" returned: 0 in 0.542s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.621s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-e560a8ce-453d-4841-8d09-d0e1d1eedaaf req-5a719e2b-60b5-4bc4-bef3-858be4d02375 tempest-DeleteServersTestJSON-1813792938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.689s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:06 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[27417907-172c-41d3-a500-31e6faf4e4ef]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-e560a8ce-453d-4841-8d09-d0e1d1eedaaf req-5a719e2b-60b5-4bc4-bef3-858be4d02375 tempest-DeleteServersTestJSON-1813792938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-40e12b92-048f-43f2-9b6b-debc315555cd req-8bd7842a-1aaa-4c8d-aece-9f20a7b1b862 tempest-VolumesSnapshotsTestJSON-1587579459 None] Create snapshot completed successfully Apr 27 23:51:06 devstack sudo[83233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 Apr 27 23:51:06 devstack sudo[83233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Acquiring lock "cinder-ff44ad54-a994-45bc-a8e9-cff78f177565-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-ff44ad54-a994-45bc-a8e9-cff78f177565-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Acquiring lock "cinder-quobyte-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-quobyte-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Acquiring lock "cinder-quobyte-ff44ad54-a994-45bc-a8e9-cff78f177565" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-quobyte-ff44ad54-a994-45bc-a8e9-cff78f177565" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Deleting offline snapshot ff44ad54-a994-45bc-a8e9-cff78f177565 of volume 6b7630a9-cf59-4488-a7c0-8ecea3f31d9e {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] snapshot_file for this snap is: volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8c62d8-f8ea-47ec-8aba-1e4826a7e1fe]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:07 devstack sudo[83233]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-e560a8ce-453d-4841-8d09-d0e1d1eedaaf req-5a719e2b-60b5-4bc4-bef3-858be4d02375 tempest-DeleteServersTestJSON-1813792938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7" returned: 0 in 0.803s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-e560a8ce-453d-4841-8d09-d0e1d1eedaaf req-5a719e2b-60b5-4bc4-bef3-858be4d02375 tempest-DeleteServersTestJSON-1813792938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.842s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-e560a8ce-453d-4841-8d09-d0e1d1eedaaf req-5a719e2b-60b5-4bc4-bef3-858be4d02375 tempest-DeleteServersTestJSON-1813792938 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6', 'name': 'volume-8991a87a-9916-4203-8476-e83be48c94e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f2843cb-502a-4ac1-9834-8d729b5c461c', 'enforce_multipath': True} {{(pid=81312) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 27 23:51:07 devstack sudo[83247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 Apr 27 23:51:07 devstack sudo[83247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:07 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-e560a8ce-453d-4841-8d09-d0e1d1eedaaf req-5a719e2b-60b5-4bc4-bef3-858be4d02375 tempest-DeleteServersTestJSON-1813792938 None] attachment_update completed successfully. Apr 27 23:51:08 devstack sudo[83247]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565" returned: 0 in 0.540s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:08 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef51ce-29b9-4496-b1d0-645d7fbd4f7e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:08 devstack sudo[83253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e Apr 27 23:51:08 devstack sudo[83253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:08 devstack sudo[83253]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" returned: 0 in 0.605s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:08 devstack sudo[83263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 Apr 27 23:51:08 devstack sudo[83263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:09 devstack sudo[83263]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565" returned: 0 in 0.617s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:09 devstack sudo[83271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565 Apr 27 23:51:09 devstack sudo[83271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:09 devstack sudo[83271]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e.ff44ad54-a994-45bc-a8e9-cff78f177565" returned: 0 in 0.532s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-quobyte-ff44ad54-a994-45bc-a8e9-cff78f177565" released by "_delete_snapshot" :: held 2.411s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-quobyte-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" released by "delete_snapshot" :: held 2.434s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:09 devstack cinder-volume[81312]: WARNING cinder.quota [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:51:10 devstack cinder-volume[81312]: DEBUG cinder.quota [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Created reservations ['d827e08b-42fb-4db4-9e9a-ffe3daadb65f', 'a9f41e30-55db-4ff8-aab4-d0adc3e599e8', 'e8060707-b31a-45b9-a4cb-6a7f7910adda', 'f6b9a6a1-8684-461b-8c39-ca95c7499fb4'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:10 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Delete snapshot completed successfully. Apr 27 23:51:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-0f8550a1-5b2a-4ee7-894f-fed3cb3a7582 req-ff1063a8-6cee-4046-a36d-581f6d2864df tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-ff44ad54-a994-45bc-a8e9-cff78f177565-delete_snapshot" released by "delete_snapshot" :: held 2.622s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Acquiring lock "cinder-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Acquiring lock "cinder-quobyte-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-quobyte-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" acquired by "delete_volume" :: waited 0.012s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:11 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5620b6-b693-4bca-9a19-5679d9d51b01]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:11 devstack sudo[83275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e Apr 27 23:51:11 devstack sudo[83275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:11 devstack sudo[83275]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" returned: 0 in 0.833s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:12 devstack sudo[83284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e Apr 27 23:51:12 devstack sudo[83284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:12 devstack sudo[83284]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" returned: 0 in 0.623s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-quobyte-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e" released by "delete_volume" :: held 1.519s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:12 devstack cinder-volume[81312]: DEBUG cinder.quota [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Created reservations ['c5c1fcec-2e61-4378-9fbd-3a818fa3e81e', '39c37f37-49b4-433d-b6e5-12d0a7f65b93', '2ec85905-6534-4c5d-ae44-c2f8c7d69994', '079aea58-3f50-47f9-a408-873f081e959c'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:12 devstack sudo[83301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:51:12 devstack sudo[83301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:13 devstack sudo[83301]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.670s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:13 devstack cinder-volume[81312]: DEBUG cinder.manager [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:51:13 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Deleted volume successfully. Apr 27 23:51:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-bf7ea9d8-7b91-4c0f-a9d2-bd23ac17aad0 req-10942ee0-fd18-42de-965a-9555174a2ba0 tempest-VolumesSnapshotsTestJSON-1587579459 None] Lock "cinder-6b7630a9-cf59-4488-a7c0-8ecea3f31d9e-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:14 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Flow 'volume_create_manager' (7c6356bc-dfb1-4969-9df2-59a563c0c67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc470e1-c5fc-48c2-a3bc-da143c317374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc470e1-c5fc-48c2-a3bc-da143c317374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-853225297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a24ed3b-a209-4e62-97e0-63c2166b8821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45fcd15afd3745288e6079b4760f865f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:15Z,use_quota=True,user_id='3cebbc32b2f1437e8a3a23377bfccadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(621b4307-c4c1-439f-bc6a-3a8aaa98f57c),volume_type_id=621b4307-c4c1-439f-bc6a-3a8aaa98f57c)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ff6774-ad4f-44af-86e6-f33163b4e118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ff6774-ad4f-44af-86e6-f33163b4e118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67db3f3-eaf0-4742-909b-8540bf433b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67db3f3-eaf0-4742-909b-8540bf433b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a24ed3b-a209-4e62-97e0-63c2166b8821', 'volume_name': 'volume-6a24ed3b-a209-4e62-97e0-63c2166b8821', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22d28e6-1963-4b71-9e5b-89a7c567681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22d28e6-1963-4b71-9e5b-89a7c567681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6947c1-f06b-4172-868b-e9b43d8de7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:15 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Volume 6a24ed3b-a209-4e62-97e0-63c2166b8821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a24ed3b-a209-4e62-97e0-63c2166b8821', 'volume_size': 1} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-853225297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a24ed3b-a209-4e62-97e0-63c2166b8821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45fcd15afd3745288e6079b4760f865f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:15Z,use_quota=True,user_id='3cebbc32b2f1437e8a3a23377bfccadf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(621b4307-c4c1-439f-bc6a-3a8aaa98f57c),volume_type_id=621b4307-c4c1-439f-bc6a-3a8aaa98f57c)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Creating volume 6a24ed3b-a209-4e62-97e0-63c2166b8821 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:51:15 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:15 devstack sudo[83343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 1073741824 Apr 27 23:51:15 devstack sudo[83343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:15 devstack sudo[83343]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 1073741824" returned: 0 in 0.701s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:15 devstack sudo[83350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 Apr 27 23:51:15 devstack sudo[83350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:16 devstack sudo[83350]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821" returned: 0 in 0.674s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:51:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6947c1-f06b-4172-868b-e9b43d8de7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a24ed3b-a209-4e62-97e0-63c2166b8821', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d309f5f7-481d-4569-8d7a-9fa10977e140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:16 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Volume volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 (6a24ed3b-a209-4e62-97e0-63c2166b8821): created successfully Apr 27 23:51:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d309f5f7-481d-4569-8d7a-9fa10977e140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Flow 'volume_create_manager' (7c6356bc-dfb1-4969-9df2-59a563c0c67e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:16 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-78910ca9-1050-4343-8125-b1ed4d908869 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Created volume successfully. Apr 27 23:51:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2714dfa6-4d04-4982-8b05-b4693afa39c8 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2714dfa6-4d04-4982-8b05-b4693afa39c8 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2714dfa6-4d04-4982-8b05-b4693afa39c8 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2714dfa6-4d04-4982-8b05-b4693afa39c8 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2714dfa6-4d04-4982-8b05-b4693afa39c8 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2714dfa6-4d04-4982-8b05-b4693afa39c8 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:17 devstack sudo[83360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:51:17 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:17 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-cf048d3d-4c9c-41a7-8b6f-71a64b0046da req-8ad0aeb8-7d5c-4b81-bdcf-5a1315d3b39a tempest-DeleteServersTestJSON-1813792938 None] Terminate volume connection completed successfully. Apr 27 23:51:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-cf048d3d-4c9c-41a7-8b6f-71a64b0046da req-8ad0aeb8-7d5c-4b81-bdcf-5a1315d3b39a tempest-DeleteServersTestJSON-1813792938 None] Deleting attachment 3f2843cb-502a-4ac1-9834-8d729b5c461c. {{(pid=81312) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 27 23:51:18 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2714dfa6-4d04-4982-8b05-b4693afa39c8 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.496s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:18 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-2714dfa6-4d04-4982-8b05-b4693afa39c8 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:51:18 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2714dfa6-4d04-4982-8b05-b4693afa39c8 tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Retype volume completed successfully. Apr 27 23:51:18 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Acquiring lock "cinder-6a24ed3b-a209-4e62-97e0-63c2166b8821-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "cinder-6a24ed3b-a209-4e62-97e0-63c2166b8821-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Acquiring lock "cinder-quobyte-6a24ed3b-a209-4e62-97e0-63c2166b8821" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "cinder-quobyte-6a24ed3b-a209-4e62-97e0-63c2166b8821" acquired by "delete_volume" :: waited 0.026s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:19 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f3ab4c-3370-4256-aa7e-cfaba081ef30]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:19 devstack sudo[83379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 Apr 27 23:51:19 devstack sudo[83379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:19 devstack sudo[83379]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821" returned: 0 in 0.716s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:19 devstack sudo[83415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821 Apr 27 23:51:19 devstack sudo[83415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:20 devstack sudo[83415]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6a24ed3b-a209-4e62-97e0-63c2166b8821" returned: 0 in 0.814s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "cinder-quobyte-6a24ed3b-a209-4e62-97e0-63c2166b8821" released by "delete_volume" :: held 1.584s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:20 devstack cinder-volume[81312]: WARNING cinder.quota [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:51:20 devstack cinder-volume[81312]: WARNING cinder.quota [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:51:20 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Created reservations ['249baad2-0321-4042-8253-05cee3376387', '58ad3dfe-bba0-4775-9f82-878d9f36754c', 'b73b47ff-d670-4cc9-aa92-2ae9a34ffade', '50f63f00-6b3a-4ff7-af52-9cf698e0a23e'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:20 devstack sudo[83422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:51:20 devstack sudo[83422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:21 devstack sudo[83422]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Acquiring lock "cinder-8991a87a-9916-4203-8476-e83be48c94e7-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.820s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:21 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:51:21 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Deleted volume successfully. Apr 27 23:51:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Lock "cinder-8991a87a-9916-4203-8476-e83be48c94e7-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-84cb607b-f913-4d67-a8dc-8dea74c0e8cc tempest-VolumeRetypeWithoutMigrationTest-1347103852 None] Lock "cinder-6a24ed3b-a209-4e62-97e0-63c2166b8821-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Acquiring lock "cinder-quobyte-8991a87a-9916-4203-8476-e83be48c94e7" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Lock "cinder-quobyte-8991a87a-9916-4203-8476-e83be48c94e7" acquired by "delete_volume" :: waited 0.025s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:21 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7088a85e-efd9-4b87-870d-df56acc25005]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:22 devstack sudo[83426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 Apr 27 23:51:22 devstack sudo[83426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:22 devstack sudo[83426]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7" returned: 0 in 1.058s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:22 devstack sudo[83431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7 Apr 27 23:51:22 devstack sudo[83431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:23 devstack sudo[83431]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8991a87a-9916-4203-8476-e83be48c94e7" returned: 0 in 0.713s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Lock "cinder-quobyte-8991a87a-9916-4203-8476-e83be48c94e7" released by "delete_volume" :: held 1.841s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:23 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Created reservations ['3e9dc09d-6f1b-4a53-aecd-36d8e7b6e99a', '5e0793e5-fcb0-4400-a680-3b397918d411', '7a5cc7b2-c94b-4743-b459-d2719764d581', '20daff31-3365-470a-99fc-da33904d3176'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:23 devstack sudo[83434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:51:23 devstack sudo[83434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:24 devstack sudo[83434]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.780s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:24 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:51:24 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Deleted volume successfully. Apr 27 23:51:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-be7c6e00-c014-487e-b4af-0aa1ba2a1cc0 tempest-DeleteServersTestJSON-1813792938 None] Lock "cinder-8991a87a-9916-4203-8476-e83be48c94e7-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Flow 'volume_create_manager' (23445855-b673-4281-9376-0c36e8baaca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c04d93-bb00-4dbe-85f7-177cc9af8412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c04d93-bb00-4dbe-85f7-177cc9af8412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-299904513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8db9c9-6622-468f-ada3-9d9f4a6149da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4ba93cb23747669bad8b9d5917afc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:26Z,use_quota=True,user_id='92aedd9665394393b3d78ea71aed1eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546abc15-c0d0-42c5-848c-e3eea95f612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546abc15-c0d0-42c5-848c-e3eea95f612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab733ed3-3f09-4826-9cc4-9a99a4d78a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab733ed3-3f09-4826-9cc4-9a99a4d78a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8db9c9-6622-468f-ada3-9d9f4a6149da', 'volume_name': 'volume-df8db9c9-6622-468f-ada3-9d9f4a6149da', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6473e7fa-094c-4a2d-9447-1b0c9074b444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6473e7fa-094c-4a2d-9447-1b0c9074b444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3479ae27-b149-483f-b291-0ce4fa316c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:26 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Volume df8db9c9-6622-468f-ada3-9d9f4a6149da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8db9c9-6622-468f-ada3-9d9f4a6149da', 'volume_size': 1} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-299904513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8db9c9-6622-468f-ada3-9d9f4a6149da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4ba93cb23747669bad8b9d5917afc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:26Z,use_quota=True,user_id='92aedd9665394393b3d78ea71aed1eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Creating volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:51:26 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:51:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:26 devstack sudo[83440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da 1073741824 Apr 27 23:51:26 devstack sudo[83440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:27 devstack sudo[83440]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da 1073741824" returned: 0 in 0.975s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:27 devstack sudo[83446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da Apr 27 23:51:27 devstack sudo[83446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:28 devstack sudo[83446]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da" returned: 0 in 0.673s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:51:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3479ae27-b149-483f-b291-0ce4fa316c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8db9c9-6622-468f-ada3-9d9f4a6149da', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b7bbf8-5666-4867-970b-08f4cfc3bf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:28 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Volume volume-df8db9c9-6622-468f-ada3-9d9f4a6149da (df8db9c9-6622-468f-ada3-9d9f4a6149da): created successfully Apr 27 23:51:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b7bbf8-5666-4867-970b-08f4cfc3bf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Flow 'volume_create_manager' (23445855-b673-4281-9376-0c36e8baaca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:28 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-19b9feb8-6d30-4f87-bd4f-e72d52cea660 tempest-SnapshotsActionsTest-230684663 None] Created volume successfully. Apr 27 23:51:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Creating offline snapshot bdbe3ae0-dcc4-4015-b81e-000b042b0229 of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:51:29 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9947a703-1c1b-47d7-b17e-c51fc41797fe]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:29 devstack sudo[83453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da Apr 27 23:51:29 devstack sudo[83453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:30 devstack sudo[83453]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da" returned: 0 in 0.819s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:30 devstack sudo[83479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 1G Apr 27 23:51:30 devstack sudo[83479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:31 devstack sudo[83479]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 1G" returned: 0 in 1.178s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:31 devstack sudo[83493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:51:31 devstack sudo[83493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:32 devstack sudo[83493]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.894s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:32 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 is being set with open permissions: ugo+rw Apr 27 23:51:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:32 devstack sudo[83499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:51:32 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:32 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.852s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:33 devstack sudo[83537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.info Apr 27 23:51:33 devstack sudo[83537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:33 devstack sudo[83537]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.info" returned: 0 in 0.546s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:33 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.info is being set with open permissions: ugo+rw Apr 27 23:51:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:33 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.info Apr 27 23:51:33 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:34 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.info" returned: 0 in 0.559s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.056s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-273d3800-26c1-49e0-9402-a2eb5f8d9fcb tempest-SnapshotsActionsTest-230684663 None] Create snapshot completed successfully Apr 27 23:51:35 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0c694061-a7ac-4137-895b-40a461f1c56c tempest-GroupsTest-1554016692 None] Group tempest-Group1-1619440609: creating Apr 27 23:51:35 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0c694061-a7ac-4137-895b-40a461f1c56c tempest-GroupsTest-1554016692 None] Group tempest-Group1-1619440609: created successfully Apr 27 23:51:35 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0c694061-a7ac-4137-895b-40a461f1c56c tempest-GroupsTest-1554016692 None] Create group completed successfully. Apr 27 23:51:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Creating offline snapshot 855761f6-981e-4634-902b-3dd1fef8f233 of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:51:35 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1db5a9f-b07b-4fce-a7fb-332a34acef15]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:35 devstack sudo[83555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:51:35 devstack sudo[83555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:35 devstack sudo[83555]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.629s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:35 devstack sudo[83582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 1G Apr 27 23:51:35 devstack sudo[83582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-41e7542c-c357-46d4-96a9-510c9a294e71 tempest-GroupsTest-1554016692 None] Group tempest-Group2-821269039: creating Apr 27 23:51:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-41e7542c-c357-46d4-96a9-510c9a294e71 tempest-GroupsTest-1554016692 None] Group tempest-Group2-821269039: created successfully Apr 27 23:51:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-41e7542c-c357-46d4-96a9-510c9a294e71 tempest-GroupsTest-1554016692 None] Create group completed successfully. Apr 27 23:51:36 devstack sudo[83582]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 1G" returned: 0 in 0.757s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:36 devstack sudo[83589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 Apr 27 23:51:36 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:37 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233" returned: 0 in 0.539s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:37 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 is being set with open permissions: ugo+rw Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:37 devstack sudo[83596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 Apr 27 23:51:37 devstack sudo[83596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Flow 'volume_create_manager' (0092388a-b45d-41ab-9cd2-86175ae08d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90ee0a5-2866-419b-b5e7-cc46f3c9cbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90ee0a5-2866-419b-b5e7-cc46f3c9cbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1982800039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=412774c8-233c-4199-a3c8-bd5ef00c6d8e,host='devstack@QuobyteHD#QuobyteHD',id=a642a32c-77cd-455c-8b2f-889957995bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b355a03fd54f69bcbb8eede941bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:38Z,use_quota=True,user_id='9209abbaaf7241db96366d1bc2594d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d8b4681-2551-4c86-833c-2f8df6ee9046),volume_type_id=0d8b4681-2551-4c86-833c-2f8df6ee9046)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9a9dde-e4c7-4545-a5bb-2801597b7ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9a9dde-e4c7-4545-a5bb-2801597b7ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451e7176-65f1-4286-82fe-2841152c035b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451e7176-65f1-4286-82fe-2841152c035b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a642a32c-77cd-455c-8b2f-889957995bba', 'volume_name': 'volume-a642a32c-77cd-455c-8b2f-889957995bba', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0187e8-da43-40d7-a665-667a1088308a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:37 devstack sudo[83596]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0187e8-da43-40d7-a665-667a1088308a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b2fa92-64be-4dc7-badb-fedd6f6c93e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:37 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Volume a642a32c-77cd-455c-8b2f-889957995bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a642a32c-77cd-455c-8b2f-889957995bba', 'volume_size': 1} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233" returned: 0 in 0.698s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.099s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=412774c8-233c-4199-a3c8-bd5ef00c6d8e,created_at=2026-04-27T21:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1982800039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=412774c8-233c-4199-a3c8-bd5ef00c6d8e,host='devstack@QuobyteHD#QuobyteHD',id=a642a32c-77cd-455c-8b2f-889957995bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b355a03fd54f69bcbb8eede941bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:38Z,use_quota=True,user_id='9209abbaaf7241db96366d1bc2594d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d8b4681-2551-4c86-833c-2f8df6ee9046),volume_type_id=0d8b4681-2551-4c86-833c-2f8df6ee9046)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Creating volume a642a32c-77cd-455c-8b2f-889957995bba {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:51:38 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:38 devstack sudo[83602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba 1073741824 Apr 27 23:51:38 devstack sudo[83602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:38 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-fdd25760-cbd1-4865-893d-9a160019ad86 tempest-SnapshotsActionsTest-230684663 None] Create snapshot completed successfully Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-855761f6-981e-4634-902b-3dd1fef8f233-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-855761f6-981e-4634-902b-3dd1fef8f233-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-quobyte-855761f6-981e-4634-902b-3dd1fef8f233" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-855761f6-981e-4634-902b-3dd1fef8f233" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Deleting offline snapshot 855761f6-981e-4634-902b-3dd1fef8f233 of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] snapshot_file for this snap is: volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4d2e2f-b287-4417-bcfe-9d4faa708e32]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:38 devstack sudo[83607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 Apr 27 23:51:38 devstack sudo[83607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:38 devstack sudo[83602]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba 1073741824" returned: 0 in 0.811s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:38 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba Apr 27 23:51:38 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:39 devstack sudo[83607]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233" returned: 0 in 0.725s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c0e5b7-d615-407e-a266-11b63bccc3ae]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:39 devstack sudo[83615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:51:39 devstack sudo[83615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:39 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba" returned: 0 in 0.651s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b2fa92-64be-4dc7-badb-fedd6f6c93e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a642a32c-77cd-455c-8b2f-889957995bba', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b606d118-3835-492e-ab8a-86169ba9b3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:39 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Volume volume-a642a32c-77cd-455c-8b2f-889957995bba (a642a32c-77cd-455c-8b2f-889957995bba): created successfully Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b606d118-3835-492e-ab8a-86169ba9b3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Flow 'volume_create_manager' (0092388a-b45d-41ab-9cd2-86175ae08d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:39 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-8eac34b8-a32a-43d4-8b4f-0fd8d2cf95d9 tempest-GroupsTest-1554016692 None] Created volume successfully. Apr 27 23:51:40 devstack sudo[83615]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.587s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:40 devstack sudo[83620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 Apr 27 23:51:40 devstack sudo[83620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Acquiring lock "cinder-quobyte-a642a32c-77cd-455c-8b2f-889957995bba" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Lock "cinder-quobyte-a642a32c-77cd-455c-8b2f-889957995bba" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:40 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[017abeeb-c36f-47d6-a8a8-4fee66c05884]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:40 devstack sudo[83620]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233" returned: 0 in 0.690s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:40 devstack sudo[83625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba Apr 27 23:51:40 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:40 devstack sudo[83626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233 Apr 27 23:51:40 devstack sudo[83626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:41 devstack sudo[83626]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.855761f6-981e-4634-902b-3dd1fef8f233" returned: 0 in 0.507s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-855761f6-981e-4634-902b-3dd1fef8f233" released by "_delete_snapshot" :: held 2.609s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" released by "delete_snapshot" :: held 2.640s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:41 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba" returned: 0 in 0.663s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:41 devstack sudo[83634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba Apr 27 23:51:41 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:41 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Created reservations ['13ced032-980f-46dd-b7a3-d8b79e9c34c1', '6f03f8dc-fcf0-41ad-9d99-f0aea1f2747c', '730f3fc5-787f-4a1c-acfc-40734a88469a', 'd183c99b-9af6-4512-abb9-3f4300e3ed46'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:41 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Delete snapshot completed successfully. Apr 27 23:51:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ade0e593-9069-4981-bd1c-a2a8c39d5c22 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-855761f6-981e-4634-902b-3dd1fef8f233-delete_snapshot" released by "delete_snapshot" :: held 2.848s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:42 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a642a32c-77cd-455c-8b2f-889957995bba" returned: 0 in 0.717s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Lock "cinder-quobyte-a642a32c-77cd-455c-8b2f-889957995bba" released by "delete_volume" :: held 1.427s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Created reservations ['f003bb97-e585-419f-af0b-74fb66ee63a4'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:42 devstack cinder-volume[81312]: WARNING cinder.quota [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-968965615 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-968965615, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:51:42 devstack cinder-volume[81312]: WARNING cinder.quota [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-968965615 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-968965615, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Created reservations ['fd924158-18ab-4f7f-9506-018852dbccbb', 'f3b684c4-20ff-438a-926e-016ba4ea47ca', '458b847d-dc60-4afd-8fdb-541c8be29111', 'a70fa3c6-60d3-49d3-9647-2bcd4f307343'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Creating offline snapshot 82efffd8-b248-4102-9d61-b9332245983a of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c3d8fd-bd6d-41f3-856c-04be0ad8708a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:42 devstack sudo[83638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:51:42 devstack sudo[83638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:42 devstack sudo[83637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:51:42 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] Created reservations ['910db902-9af5-493c-a284-4c214183b748'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:43 devstack sudo[83642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:51:43 devstack sudo[83642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:43 devstack sudo[83638]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.799s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:51:43 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-aac46636-d2ad-41c8-893d-0ff5422309e7 tempest-GroupsTest-1554016692 None] Delete group completed successfully. Apr 27 23:51:43 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 1.077s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:43 devstack sudo[83647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a 1G Apr 27 23:51:43 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:43 devstack sudo[83642]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.745s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:43 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:51:43 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f2ba6488-8001-46d2-ab19-defe422d4fdd tempest-GroupsTest-1554016692 None] Delete group completed successfully. Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Flow 'volume_create_manager' (8e6b5046-7666-4390-9043-2cdea32f5b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b8e69-ec36-4694-ac86-3891344d679b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b8e69-ec36-4694-ac86-3891344d679b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:44Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7af2aa6-9297-4cb3-8462-e99cc31a7a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdae3515d93d4d13a83def5e53742a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:44Z,use_quota=True,user_id='894bb64f14424ff4b256cbd2313c4224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8212edc7-3038-4c21-8323-cf260d471ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8212edc7-3038-4c21-8323-cf260d471ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fd0d23-cc47-4a85-a46a-459bb54da695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.image.glance [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Creating Keystone auth plugin from conf {{(pid=81312) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Flow 'volume_create_manager' (2b12a49c-daba-46e0-8856-31bfbd10aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7ef234-244e-41bf-b3a9-ba6a483291f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7ef234-244e-41bf-b3a9-ba6a483291f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1931950264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cced98-3363-4302-9f8d-f7bdeeebdc9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a56e0872fb04f1d8d664606f384ab98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:44Z,use_quota=True,user_id='3cd60094e8a344c1a962a977b0a8a143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf852bcf-9ec0-4bd2-8317-fea215cd422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf852bcf-9ec0-4bd2-8317-fea215cd422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfc44d3-0cbc-4569-9e1d-0ae00522617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.image.glance [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Creating Keystone auth plugin from conf {{(pid=81312) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 27 23:51:44 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a 1G" returned: 0 in 1.144s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:44 devstack sudo[83656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a Apr 27 23:51:44 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfc44d3-0cbc-4569-9e1d-0ae00522617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96cced98-3363-4302-9f8d-f7bdeeebdc9a', 'volume_name': 'volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361a5a01-b995-47c1-b2f7-2079c6204fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361a5a01-b995-47c1-b2f7-2079c6204fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96a7ec3-2958-4b0b-a103-e3df321351b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Volume 96cced98-3363-4302-9f8d-f7bdeeebdc9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Trying to clone 96cced98-3363-4302-9f8d-f7bdeeebdc9a from image 8f48a915-9605-48af-ab48-fa6fc721c0a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]). {{(pid=81312) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fd0d23-cc47-4a85-a46a-459bb54da695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7af2aa6-9297-4cb3-8462-e99cc31a7a6b', 'volume_name': 'volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ac0bdd-ca3d-46d0-848c-f77c645d7f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ac0bdd-ca3d-46d0-848c-f77c645d7f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93cf683-a945-428b-b577-b54e799eacef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:44 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Volume b7af2aa6-9297-4cb3-8462-e99cc31a7a6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 27 23:51:44 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Trying to clone b7af2aa6-9297-4cb3-8462-e99cc31a7a6b from image 8f48a915-9605-48af-ab48-fa6fc721c0a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]). {{(pid=81312) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 27 23:51:44 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-4f49d4c7-5f66-41a0-8a55-77e54b1892cf tempest-GroupsTest-1554016692 None] Group tempest-GroupsTest-Group-554072280: creating Apr 27 23:51:45 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-4f49d4c7-5f66-41a0-8a55-77e54b1892cf tempest-GroupsTest-1554016692 None] Group tempest-GroupsTest-Group-554072280: created successfully Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:45 devstack sudo[83678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:51:45 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:45 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-4f49d4c7-5f66-41a0-8a55-77e54b1892cf tempest-GroupsTest-1554016692 None] Create group completed successfully. Apr 27 23:51:45 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a" returned: 0 in 0.843s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:45 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a is being set with open permissions: ugo+rw Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:45 devstack sudo[83685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a Apr 27 23:51:45 devstack sudo[83685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 27 23:51:45 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Image download 20.69 MB at 20.69 MB/s Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 27 23:51:45 devstack cinder-volume[81312]: INFO cinder.image.image_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Image download 20.69 MB at 20.69 MB/s Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee43712-01db-4c39-9d33-714ea35730a8]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[209faef1-787e-4b66-a5f1-e4c43cb59591]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:45 devstack sudo[83687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD Apr 27 23:51:45 devstack sudo[83687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:45 devstack sudo[83688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD Apr 27 23:51:45 devstack sudo[83688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:45 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.646s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:51:45 devstack sudo[83685]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a" returned: 0 in 0.502s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.674s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:45 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1aa14c07-d911-406a-a11e-337eea84e829 tempest-SnapshotsActionsTest-230684663 None] Create snapshot completed successfully Apr 27 23:51:46 devstack sudo[83687]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD" returned: 0 in 0.525s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Temporary image 8f48a915-9605-48af-ab48-fa6fc721c0a5 is fetched for user 3cd60094e8a344c1a962a977b0a8a143. {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[623606a8-9990-4670-8801-e900dad2ab1a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:46 devstack sudo[83688]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD" returned: 0 in 0.635s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Temporary image 8f48a915-9605-48af-ab48-fa6fc721c0a5 is fetched for user 894bb64f14424ff4b256cbd2313c4224. {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-82efffd8-b248-4102-9d61-b9332245983a-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:46 devstack sudo[83699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD Apr 27 23:51:46 devstack sudo[83699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-82efffd8-b248-4102-9d61-b9332245983a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1754a2-7d01-4cbc-a328-d60ea1edf746]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" acquired by "delete_snapshot" :: waited 0.096s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-quobyte-82efffd8-b248-4102-9d61-b9332245983a" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-82efffd8-b248-4102-9d61-b9332245983a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Deleting offline snapshot 82efffd8-b248-4102-9d61-b9332245983a of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:51:46 devstack sudo[83701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD Apr 27 23:51:46 devstack sudo[83701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] snapshot_file for this snap is: volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Flow 'volume_create_manager' (b9287598-3e36-487f-912c-bcc7ea9b1d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421f8d71-af3a-45b7-b93f-9450b582ea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d26730-3541-43da-bd2f-2438d24fd235]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421f8d71-af3a-45b7-b93f-9450b582ea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250841081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccf1e9af-a203-427a-b16d-299e7a165abf,host='devstack@QuobyteHD#QuobyteHD',id=8750599e-5c22-4e8f-80ef-cb6233663e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b355a03fd54f69bcbb8eede941bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:46Z,use_quota=True,user_id='9209abbaaf7241db96366d1bc2594d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa956e62-a323-4aa3-895d-4738063d76d5),volume_type_id=aa956e62-a323-4aa3-895d-4738063d76d5)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbd84c8-ae3a-440a-a73c-e54ea93c7b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbd84c8-ae3a-440a-a73c-e54ea93c7b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d4f85b-bc6b-436b-b1dd-58f2a0922331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d4f85b-bc6b-436b-b1dd-58f2a0922331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8750599e-5c22-4e8f-80ef-cb6233663e3f', 'volume_name': 'volume-8750599e-5c22-4e8f-80ef-cb6233663e3f', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7050da-18fb-428c-863f-901b07a94800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7050da-18fb-428c-863f-901b07a94800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9c4a42-b334-452d-9c09-83e9b94cd461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:46 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Volume 8750599e-5c22-4e8f-80ef-cb6233663e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8750599e-5c22-4e8f-80ef-cb6233663e3f', 'volume_size': 1} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ccf1e9af-a203-427a-b16d-299e7a165abf,created_at=2026-04-27T21:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250841081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccf1e9af-a203-427a-b16d-299e7a165abf,host='devstack@QuobyteHD#QuobyteHD',id=8750599e-5c22-4e8f-80ef-cb6233663e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b355a03fd54f69bcbb8eede941bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:46Z,use_quota=True,user_id='9209abbaaf7241db96366d1bc2594d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa956e62-a323-4aa3-895d-4738063d76d5),volume_type_id=aa956e62-a323-4aa3-895d-4738063d76d5)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Creating volume 8750599e-5c22-4e8f-80ef-cb6233663e3f {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:51:46 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:46 devstack sudo[83704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f 1073741824 Apr 27 23:51:46 devstack sudo[83704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:46 devstack sudo[83703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a Apr 27 23:51:46 devstack sudo[83703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:46 devstack sudo[83699]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:47 devstack sudo[83701]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:47 devstack sudo[83703]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a" returned: 0 in 0.631s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[52edd200-f52d-4f4d-8c3d-eb585a799cc6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:47 devstack sudo[83719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:51:47 devstack sudo[83719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:47 devstack sudo[83704]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f 1073741824" returned: 0 in 0.689s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:47 devstack sudo[83721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f Apr 27 23:51:47 devstack sudo[83721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:47 devstack sudo[83719]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.552s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:47 devstack sudo[83727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a Apr 27 23:51:47 devstack sudo[83727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:47 devstack sudo[83721]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f" returned: 0 in 0.466s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.798s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1931950264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cced98-3363-4302-9f8d-f7bdeeebdc9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a56e0872fb04f1d8d664606f384ab98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:44Z,use_quota=True,user_id='3cd60094e8a344c1a962a977b0a8a143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Creating volume 96cced98-3363-4302-9f8d-f7bdeeebdc9a {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:51:47 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9c4a42-b334-452d-9c09-83e9b94cd461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8750599e-5c22-4e8f-80ef-cb6233663e3f', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:47 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a 1073741824 Apr 27 23:51:47 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc06c19d-27f6-4d95-a40f-6c5ddd249fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:47 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Volume volume-8750599e-5c22-4e8f-80ef-cb6233663e3f (8750599e-5c22-4e8f-80ef-cb6233663e3f): created successfully Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc06c19d-27f6-4d95-a40f-6c5ddd249fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Flow 'volume_create_manager' (b9287598-3e36-487f-912c-bcc7ea9b1d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:47 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ebc78d3b-62ab-43a9-89fb-6c319ec3f4c8 tempest-GroupsTest-1554016692 None] Created volume successfully. Apr 27 23:51:48 devstack sudo[83727]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a" returned: 0 in 0.604s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:48 devstack sudo[83738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a Apr 27 23:51:48 devstack sudo[83738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:48 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a 1073741824" returned: 0 in 0.621s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:48 devstack sudo[83740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a Apr 27 23:51:48 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:48 devstack sudo[83738]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.82efffd8-b248-4102-9d61-b9332245983a" returned: 0 in 0.476s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-82efffd8-b248-4102-9d61-b9332245983a" released by "_delete_snapshot" :: held 2.369s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" released by "delete_snapshot" :: held 2.404s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Created reservations ['732fe808-5a52-4e95-af51-5ce08b17adab', 'f02970f3-6ce9-454a-97dd-6e101d85d2f1', '74dc6ea5-eb87-4723-aa4a-92277238c376', '96e4ab54-b98f-411a-88ce-d65dfe550884'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:48 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a" returned: 0 in 0.531s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:44Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7af2aa6-9297-4cb3-8462-e99cc31a7a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdae3515d93d4d13a83def5e53742a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:44Z,use_quota=True,user_id='894bb64f14424ff4b256cbd2313c4224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Creating volume b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:51:48 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:51:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:49 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Delete snapshot completed successfully. Apr 27 23:51:49 devstack sudo[83744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b 1073741824 Apr 27 23:51:49 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e75c594c-f0ec-41ac-b86d-e7b99bd1fd8a tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-82efffd8-b248-4102-9d61-b9332245983a-delete_snapshot" released by "delete_snapshot" :: held 2.683s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Attempting download of 8f48a915-9605-48af-ab48-fa6fc721c0a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}])) to volume 96cced98-3363-4302-9f8d-f7bdeeebdc9a. {{(pid=81312) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[80601fbe-51b9-473c-8fb8-883bab5410e6]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ion9_94v {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Flow 'volume_create_manager' (0893da9a-fbff-47c6-9b75-98f18999857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f766733a-8df0-467e-8d33-5f7ae01211c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f766733a-8df0-467e-8d33-5f7ae01211c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-139969343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccf1e9af-a203-427a-b16d-299e7a165abf,host='devstack@QuobyteHD#QuobyteHD',id=df982056-3da0-48d1-82a2-c06c26a4a727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b355a03fd54f69bcbb8eede941bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:49Z,use_quota=True,user_id='9209abbaaf7241db96366d1bc2594d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa956e62-a323-4aa3-895d-4738063d76d5),volume_type_id=aa956e62-a323-4aa3-895d-4738063d76d5)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84015105-d3a9-48f2-9326-3f8c651b6f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84015105-d3a9-48f2-9326-3f8c651b6f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d690d18d-8062-4be9-a4c8-cdbdc80c4e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d690d18d-8062-4be9-a4c8-cdbdc80c4e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df982056-3da0-48d1-82a2-c06c26a4a727', 'volume_name': 'volume-df982056-3da0-48d1-82a2-c06c26a4a727', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f58822-57be-41de-a281-d59c33e01a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:49 devstack sudo[83746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ion9_94v Apr 27 23:51:49 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f58822-57be-41de-a281-d59c33e01a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775b69db-1c44-4251-bfa4-7ef1e7fa66ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:49 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Volume df982056-3da0-48d1-82a2-c06c26a4a727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df982056-3da0-48d1-82a2-c06c26a4a727', 'volume_size': 1} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:49 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ion9_94v" returned: 0 in 0.550s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ion9_94v {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:49 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b 1073741824" returned: 0 in 0.725s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:49 devstack sudo[83753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ion9_94v Apr 27 23:51:49 devstack sudo[83753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:49 devstack sudo[83755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b Apr 27 23:51:49 devstack sudo[83755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:50 devstack sudo[83753]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ion9_94v" returned: 1 in 0.512s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ion9_94v' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bd7d21-1d0e-4b69-8d99-314f57df36f6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:50 devstack sudo[83755]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" returned: 0 in 0.459s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.045s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ccf1e9af-a203-427a-b16d-299e7a165abf,created_at=2026-04-27T21:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-139969343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccf1e9af-a203-427a-b16d-299e7a165abf,host='devstack@QuobyteHD#QuobyteHD',id=df982056-3da0-48d1-82a2-c06c26a4a727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b355a03fd54f69bcbb8eede941bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:51:49Z,use_quota=True,user_id='9209abbaaf7241db96366d1bc2594d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa956e62-a323-4aa3-895d-4738063d76d5),volume_type_id=aa956e62-a323-4aa3-895d-4738063d76d5)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Creating volume df982056-3da0-48d1-82a2-c06c26a4a727 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:51:50 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:50 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD Apr 27 23:51:50 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:50 devstack sudo[83762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727 1073741824 Apr 27 23:51:50 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Attempting download of 8f48a915-9605-48af-ab48-fa6fc721c0a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}])) to volume b7af2aa6-9297-4cb3-8462-e99cc31a7a6b. {{(pid=81312) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[af752fa7-7270-4b86-aeb6-b90d62e7bcf7]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_vxhpwimp {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:50 devstack sudo[83764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_vxhpwimp Apr 27 23:51:50 devstack sudo[83764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:50 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD" returned: 0 in 0.565s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] 8f48a915-9605-48af-ab48-fa6fc721c0a5 was qcow2, converting to raw {{(pid=81312) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:50 devstack sudo[83772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a Apr 27 23:51:50 devstack sudo[83772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:50 devstack sudo[83764]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_vxhpwimp" returned: 0 in 0.559s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_vxhpwimp {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:50 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727 1073741824" returned: 0 in 0.666s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:50 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727 Apr 27 23:51:50 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:50 devstack sudo[83776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_vxhpwimp Apr 27 23:51:50 devstack sudo[83776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:51 devstack sudo[83776]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_vxhpwimp" returned: 1 in 0.519s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_vxhpwimp' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3de166a-886f-4fb8-b50d-ad678ac8b1b7]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:51 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727" returned: 0 in 0.478s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.607s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Creating offline snapshot 212cbe81-21c5-47e2-9ddd-97f8adab5699 of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:51:51 devstack sudo[83794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD Apr 27 23:51:51 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775b69db-1c44-4251-bfa4-7ef1e7fa66ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df982056-3da0-48d1-82a2-c06c26a4a727', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a6b9b3-4e1a-4cb4-a32c-44303e756126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f31ccbf-af04-4d23-a2df-974eeb051e47]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:51 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Volume volume-df982056-3da0-48d1-82a2-c06c26a4a727 (df982056-3da0-48d1-82a2-c06c26a4a727): created successfully Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a6b9b3-4e1a-4cb4-a32c-44303e756126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Flow 'volume_create_manager' (0893da9a-fbff-47c6-9b75-98f18999857b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:51 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f894c4a6-4f6f-4ebd-9676-c1ccf87a6f9a tempest-GroupsTest-1554016692 None] Created volume successfully. Apr 27 23:51:51 devstack sudo[83796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:51:51 devstack sudo[83796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:52 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD" returned: 0 in 0.643s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] 8f48a915-9605-48af-ab48-fa6fc721c0a5 was qcow2, converting to raw {{(pid=81312) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:52 devstack sudo[83803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b Apr 27 23:51:52 devstack sudo[83803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:52 devstack sudo[83772]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a" returned: 0 in 1.356s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_fk3u5oegdevstack@QuobyteHD, size 112.00 MB, duration 1.36 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:51:52 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Converted 112.00 MB image at 82.46 MB/s Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:52 devstack sudo[83806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a 1G Apr 27 23:51:52 devstack sudo[83806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:52 devstack sudo[83796]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.645s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:52 devstack sudo[83808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 1G Apr 27 23:51:52 devstack sudo[83808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:52 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-36ff19e3-06e3-4684-b72e-f74c1f8c7573 tempest-GroupsTest-1554016692 None] Update group completed successfully. Apr 27 23:51:52 devstack sudo[83806]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a 1G" returned: 0 in 0.583s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec834730-8efa-4363-b834-68469364691b]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:52 devstack sudo[83830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a Apr 27 23:51:52 devstack sudo[83830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:52 devstack sudo[83808]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 1G" returned: 0 in 0.677s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:52 devstack sudo[83832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 Apr 27 23:51:52 devstack sudo[83832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:53 devstack sudo[83830]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a" returned: 0 in 0.647s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:53 devstack sudo[83832]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699" returned: 0 in 0.619s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:53 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 is being set with open permissions: ugo+rw Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:53 devstack sudo[83839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a Apr 27 23:51:53 devstack sudo[83839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:53 devstack sudo[83840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 Apr 27 23:51:53 devstack sudo[83840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:53 devstack sudo[83803]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" returned: 0 in 1.506s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_5k978krqdevstack@QuobyteHD, size 112.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:51:53 devstack cinder-volume[81312]: INFO cinder.image.image_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Converted 112.00 MB image at 74.29 MB/s Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:53 devstack sudo[83843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b 1G Apr 27 23:51:53 devstack sudo[83843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ad8ef88f-78bc-4b2a-a806-5d4c255e1867 tempest-GroupsTest-1554016692 None] Update group completed successfully. Apr 27 23:51:53 devstack sudo[83839]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a" returned: 1 in 0.534s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Downloaded image 8f48a915-9605-48af-ab48-fa6fc721c0a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}])) to volume 96cced98-3363-4302-9f8d-f7bdeeebdc9a successfully. {{(pid=81312) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Temporary image 8f48a915-9605-48af-ab48-fa6fc721c0a5 for user 3cd60094e8a344c1a962a977b0a8a143 is deleted. {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Marking volume 96cced98-3363-4302-9f8d-f7bdeeebdc9a as bootable. {{(pid=81312) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Copying metadata from image 8f48a915-9605-48af-ab48-fa6fc721c0a5 to 96cced98-3363-4302-9f8d-f7bdeeebdc9a. {{(pid=81312) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 27 23:51:53 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Creating volume glance metadata for volume 96cced98-3363-4302-9f8d-f7bdeeebdc9a backed by image 8f48a915-9605-48af-ab48-fa6fc721c0a5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81312) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96a7ec3-2958-4b0b-a103-e3df321351b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e3cd40-ae79-44be-96cf-158b04dd2a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:54 devstack sudo[83840]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:54 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Volume volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a (96cced98-3363-4302-9f8d-f7bdeeebdc9a): created successfully Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e3cd40-ae79-44be-96cf-158b04dd2a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Flow 'volume_create_manager' (2b12a49c-daba-46e0-8856-31bfbd10aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699" returned: 0 in 0.589s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:54 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-483b79a4-0ce1-4704-8c46-3abb1fa721dc tempest-VolumesImageMetadata-758027340 None] Created volume successfully. Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:54 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-dd5262e4-69eb-4c43-b847-75cd207c14b7 tempest-SnapshotsActionsTest-230684663 None] Create snapshot completed successfully Apr 27 23:51:54 devstack sudo[83843]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b 1G" returned: 0 in 0.584s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daa00d2-efc7-4b95-80c4-9d074b44260a]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:54 devstack sudo[83852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b Apr 27 23:51:54 devstack sudo[83852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:54 devstack sudo[83852]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" returned: 0 in 0.514s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:54 devstack sudo[83856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b Apr 27 23:51:54 devstack sudo[83856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:55 devstack sudo[83856]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Acquiring lock "cinder-quobyte-8750599e-5c22-4e8f-80ef-cb6233663e3f" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" returned: 1 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Downloaded image 8f48a915-9605-48af-ab48-fa6fc721c0a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}])) to volume b7af2aa6-9297-4cb3-8462-e99cc31a7a6b successfully. {{(pid=81312) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Temporary image 8f48a915-9605-48af-ab48-fa6fc721c0a5 for user 894bb64f14424ff4b256cbd2313c4224 is deleted. {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Marking volume b7af2aa6-9297-4cb3-8462-e99cc31a7a6b as bootable. {{(pid=81312) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Lock "cinder-quobyte-8750599e-5c22-4e8f-80ef-cb6233663e3f" acquired by "delete_volume" :: waited 0.043s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Copying metadata from image 8f48a915-9605-48af-ab48-fa6fc721c0a5 to b7af2aa6-9297-4cb3-8462-e99cc31a7a6b. {{(pid=81312) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Creating volume glance metadata for volume b7af2aa6-9297-4cb3-8462-e99cc31a7a6b backed by image 8f48a915-9605-48af-ab48-fa6fc721c0a5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81312) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8729e1-cac1-44d8-afda-481cbb8883aa]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-212cbe81-21c5-47e2-9ddd-97f8adab5699-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-212cbe81-21c5-47e2-9ddd-97f8adab5699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:55 devstack sudo[83861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f Apr 27 23:51:55 devstack sudo[83861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-quobyte-212cbe81-21c5-47e2-9ddd-97f8adab5699" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93cf683-a945-428b-b577-b54e799eacef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98f8d19-92e6-46be-bc3d-195a1449c513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-212cbe81-21c5-47e2-9ddd-97f8adab5699" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Deleting offline snapshot 212cbe81-21c5-47e2-9ddd-97f8adab5699 of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] snapshot_file for this snap is: volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:51:55 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Volume volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b (b7af2aa6-9297-4cb3-8462-e99cc31a7a6b): created successfully Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98f8d19-92e6-46be-bc3d-195a1449c513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Flow 'volume_create_manager' (8e6b5046-7666-4390-9043-2cdea32f5b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ccf8c2-5df3-4d90-9730-8664f5b71490]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Acquiring lock "cinder-96cced98-3363-4302-9f8d-f7bdeeebdc9a-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:55 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-ca541e61-950c-4dce-92b8-b449eb1026b7 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Created volume successfully. Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Lock "cinder-96cced98-3363-4302-9f8d-f7bdeeebdc9a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Acquiring lock "cinder-quobyte-96cced98-3363-4302-9f8d-f7bdeeebdc9a" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:55 devstack sudo[83863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 Apr 27 23:51:55 devstack sudo[83863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Lock "cinder-quobyte-96cced98-3363-4302-9f8d-f7bdeeebdc9a" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc03199-d9f4-4dfd-b3f2-dfc3b1840ee2]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:55 devstack sudo[83865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a Apr 27 23:51:55 devstack sudo[83865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:55 devstack sudo[83861]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f" returned: 0 in 0.657s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:55 devstack sudo[83872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f Apr 27 23:51:55 devstack sudo[83872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:56 devstack sudo[83863]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699" returned: 0 in 0.525s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee63de-e6fd-4e1b-add1-269c32dc8852]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:56 devstack sudo[83875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:51:56 devstack sudo[83875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:56 devstack sudo[83865]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a" returned: 0 in 0.526s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:56 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a Apr 27 23:51:56 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:56 devstack sudo[83872]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8750599e-5c22-4e8f-80ef-cb6233663e3f" returned: 0 in 0.506s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Lock "cinder-quobyte-8750599e-5c22-4e8f-80ef-cb6233663e3f" released by "delete_volume" :: held 1.213s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Acquiring lock "cinder-quobyte-df982056-3da0-48d1-82a2-c06c26a4a727" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Lock "cinder-quobyte-df982056-3da0-48d1-82a2-c06c26a4a727" acquired by "delete_volume" :: waited 0.029s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9a204b-193e-45b3-a6d6-b437bb02ed10]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:56 devstack sudo[83885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727 Apr 27 23:51:56 devstack sudo[83885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:56 devstack sudo[83875]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.589s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:56 devstack sudo[83890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 Apr 27 23:51:56 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:56 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=121,cinder:UPDATE=104,cinder:INSERT=38,cinder:DELETE=6 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a" returned: 1 in 0.659s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=117,cinder:UPDATE=101,cinder:DELETE=11,cinder:INSERT=29 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:56 devstack sudo[83900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a Apr 27 23:51:56 devstack sudo[83900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[870255f3-cf90-45e4-8404-6a5ed5b1a4cb]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:57 devstack sudo[83903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b Apr 27 23:51:57 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:57 devstack sudo[83885]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727" returned: 0 in 0.692s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:57 devstack sudo[83911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727 Apr 27 23:51:57 devstack sudo[83911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:57 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699" returned: 0 in 0.633s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:57 devstack sudo[83913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699 Apr 27 23:51:57 devstack sudo[83913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:57 devstack sudo[83900]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-96cced98-3363-4302-9f8d-f7bdeeebdc9a" returned: 0 in 0.532s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Lock "cinder-quobyte-96cced98-3363-4302-9f8d-f7bdeeebdc9a" released by "delete_volume" :: held 1.789s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Created reservations ['78fd07c4-fd02-4ce2-89e0-6efef8ded0b1', '56ec6056-ab1e-418b-a68f-fc4db33edd55', '3bc3d2f1-74d0-4421-9d18-ae3c0ed49d28', '78f99b2f-d626-4c8c-9007-8adc8cf8fd65'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:57 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" returned: 0 in 0.635s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:57 devstack sudo[83919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:51:57 devstack sudo[83919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:57 devstack sudo[83918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b Apr 27 23:51:57 devstack sudo[83918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:57 devstack sudo[83911]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df982056-3da0-48d1-82a2-c06c26a4a727" returned: 0 in 0.557s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Lock "cinder-quobyte-df982056-3da0-48d1-82a2-c06c26a4a727" released by "delete_volume" :: held 1.294s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:57 devstack sudo[83913]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Created reservations ['7b11c8de-738d-4184-a3c5-106fb9035dec'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.212cbe81-21c5-47e2-9ddd-97f8adab5699" returned: 0 in 0.590s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-212cbe81-21c5-47e2-9ddd-97f8adab5699" released by "_delete_snapshot" :: held 2.479s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" released by "delete_snapshot" :: held 2.544s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:57 devstack cinder-volume[81312]: WARNING cinder.quota [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-417074691 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-417074691, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:51:57 devstack cinder-volume[81312]: WARNING cinder.quota [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-417074691 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-417074691, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Created reservations ['e528e073-4e74-4c30-b65a-da717f45344c', 'aee0b1dc-080d-4601-a0ec-4b629223faa2', '8c768ccd-4eec-4043-99c8-d78089393f9b', '67ea5c87-0d3b-4fa0-b1af-d771b40e5f06'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Created reservations ['e35d2822-31fa-43bb-9050-796187b08c61', '1cab9809-bd38-484a-8870-c9fe9589ab37', '801f905b-0fdc-4215-b3e4-e9fd8201500f', 'bdb80c81-cf5a-479c-803f-a9561c01d404'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Created reservations ['b5f81b38-dc9e-42b4-81d9-4912c6807334', '8a04c352-b019-4097-94bb-b1e51cfedac4', '0560daa9-751c-4265-9d1a-8aad8eab5701', '3fd75167-37dc-4a6c-99e9-2c1ec7341cb8'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:51:58 devstack sudo[83919]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.575s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:51:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Deleted volume successfully. Apr 27 23:51:58 devstack sudo[83918]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" returned: 1 in 0.632s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.315s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d5b9b303-1bf6-4c3f-8bdf-dee0bf6f0385 tempest-VolumesImageMetadata-758027340 None] Lock "cinder-96cced98-3363-4302-9f8d-f7bdeeebdc9a-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6', 'name': 'volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0a58d2e-3ffd-49ca-ab26-3e5f4446011a', 'enforce_multipath': True} {{(pid=81312) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 27 23:51:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Delete snapshot completed successfully. Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c9eeb3b6-06e7-41fa-a7b9-4344fc69b009 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-212cbe81-21c5-47e2-9ddd-97f8adab5699-delete_snapshot" released by "delete_snapshot" :: held 2.942s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:51:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:58 devstack sudo[83931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:51:58 devstack sudo[83931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-fb951407-ca69-43b9-9ffb-2811e72c0635 req-faa3d533-2034-4161-8879-368545b341c2 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] attachment_update completed successfully. Apr 27 23:51:59 devstack sudo[83931]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.629s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:51:59 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-8b1fd399-06c1-449f-b2ad-cbab69edc865 tempest-GroupsTest-1554016692 None] Delete group completed successfully. Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Creating offline snapshot e72ee88a-5483-4bd0-bda1-f1feaf16ce90 of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78f5e97-583a-4e75-8b02-fe2d0dd02f8d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:59 devstack sudo[83934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:51:59 devstack sudo[83934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:51:59 devstack sudo[83934]: pam_unix(sudo:session): session closed for user root Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.683s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:51:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:51:59 devstack sudo[83939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 1G Apr 27 23:51:59 devstack sudo[83939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:00 devstack sudo[83939]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 1G" returned: 0 in 0.817s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:00 devstack sudo[83944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 Apr 27 23:52:00 devstack sudo[83944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:01 devstack sudo[83944]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90" returned: 0 in 0.632s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:01 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 is being set with open permissions: ugo+rw Apr 27 23:52:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:01 devstack sudo[83949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 Apr 27 23:52:01 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:01 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90" returned: 0 in 0.532s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.806s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:01 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e50ebad4-80e7-4677-badb-1e64a151ca64 tempest-SnapshotsActionsTest-230684663 None] Create snapshot completed successfully Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-e72ee88a-5483-4bd0-bda1-f1feaf16ce90-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-e72ee88a-5483-4bd0-bda1-f1feaf16ce90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Acquiring lock "cinder-quobyte-e72ee88a-5483-4bd0-bda1-f1feaf16ce90" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-e72ee88a-5483-4bd0-bda1-f1feaf16ce90" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Deleting offline snapshot e72ee88a-5483-4bd0-bda1-f1feaf16ce90 of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] snapshot_file for this snap is: volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[437a8386-dddb-4a52-8702-f4ce30ccedd4]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:02 devstack sudo[83955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 Apr 27 23:52:02 devstack sudo[83955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Flow 'volume_create_manager' (d1f9c359-d64f-4fff-b7bc-f4e060718b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3987f5d3-3519-4122-b226-23c14b1936c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3987f5d3-3519-4122-b226-23c14b1936c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1309826478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af56d29-5f26-47f8-bb0b-4f9b702541f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3dd819cf1ea44599d1cffe6faa31cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:03Z,use_quota=True,user_id='267036bcc0bc467ea01a5c5ae93723fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ffc7a0-d374-405a-830c-c4b1042b654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ffc7a0-d374-405a-830c-c4b1042b654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bff550-144d-4258-abf6-bbe7d8f7571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bff550-144d-4258-abf6-bbe7d8f7571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af56d29-5f26-47f8-bb0b-4f9b702541f2', 'volume_name': 'volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfeaf34-a187-46d7-ac08-ffcceaefe913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfeaf34-a187-46d7-ac08-ffcceaefe913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d398c7-b2a1-4b8b-869f-5532e922af01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:02 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Volume 9af56d29-5f26-47f8-bb0b-4f9b702541f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2', 'volume_size': 1} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1309826478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af56d29-5f26-47f8-bb0b-4f9b702541f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3dd819cf1ea44599d1cffe6faa31cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:03Z,use_quota=True,user_id='267036bcc0bc467ea01a5c5ae93723fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Creating volume 9af56d29-5f26-47f8-bb0b-4f9b702541f2 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:02 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:02 devstack sudo[83958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 1073741824 Apr 27 23:52:02 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:03 devstack sudo[83955]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90" returned: 0 in 0.605s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:52:03 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[938c1d05-cd8e-4081-9c31-e3ecc2e1a9c5]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:03 devstack sudo[83963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:52:03 devstack sudo[83963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:03 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 1073741824" returned: 0 in 0.770s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:03 devstack sudo[83979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 Apr 27 23:52:03 devstack sudo[83979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:03 devstack sudo[83963]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.722s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:52:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:03 devstack sudo[83981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 Apr 27 23:52:03 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:04 devstack sudo[83979]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2" returned: 0 in 0.536s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d398c7-b2a1-4b8b-869f-5532e922af01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe13027b-a89c-4d28-9d05-8a49c1c0c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:04 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Volume volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 (9af56d29-5f26-47f8-bb0b-4f9b702541f2): created successfully Apr 27 23:52:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe13027b-a89c-4d28-9d05-8a49c1c0c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Flow 'volume_create_manager' (d1f9c359-d64f-4fff-b7bc-f4e060718b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:04 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-37bdf07a-9817-4103-8e14-15b71824f628 tempest-VolumesTransfersTest-1224025689 None] Created volume successfully. Apr 27 23:52:04 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90" returned: 0 in 0.727s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:04 devstack sudo[84006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90 Apr 27 23:52:04 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:05 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.e72ee88a-5483-4bd0-bda1-f1feaf16ce90" returned: 0 in 0.851s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-e72ee88a-5483-4bd0-bda1-f1feaf16ce90" released by "_delete_snapshot" :: held 3.023s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" released by "delete_snapshot" :: held 3.057s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:05 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Created reservations ['18397bbf-a28f-41ac-8d9f-a06f789baaba', '7fa2f2f7-ad01-4aa5-81f0-dce416f3e83c', '362125ab-807d-4906-8176-3de80988769a', '0d994490-83c3-49e2-9222-dc7c77ee08dc'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:05 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Delete snapshot completed successfully. Apr 27 23:52:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fde84e7a-7cff-40e4-a66e-0b0585d63c48 tempest-SnapshotsActionsTest-344234216 None] Lock "cinder-e72ee88a-5483-4bd0-bda1-f1feaf16ce90-delete_snapshot" released by "delete_snapshot" :: held 3.279s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e9c1b2af-543e-463c-ae93-f2c2d4bbee4c tempest-VolumesTransfersTest-1721314435 None] Transfer volume completed successfully. Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "cinder-bdbe3ae0-dcc4-4015-b81e-000b042b0229-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-bdbe3ae0-dcc4-4015-b81e-000b042b0229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" acquired by "delete_snapshot" :: waited 0.044s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "cinder-quobyte-bdbe3ae0-dcc4-4015-b81e-000b042b0229" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-quobyte-bdbe3ae0-dcc4-4015-b81e-000b042b0229" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Deleting offline snapshot bdbe3ae0-dcc4-4015-b81e-000b042b0229 of volume df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] snapshot_file for this snap is: volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880e2c9-e960-46be-bfa8-6572afe748eb]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Acquiring lock "cinder-9af56d29-5f26-47f8-bb0b-4f9b702541f2-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Lock "cinder-9af56d29-5f26-47f8-bb0b-4f9b702541f2-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:07 devstack sudo[84030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:52:07 devstack sudo[84030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Acquiring lock "cinder-quobyte-9af56d29-5f26-47f8-bb0b-4f9b702541f2" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Lock "cinder-quobyte-9af56d29-5f26-47f8-bb0b-4f9b702541f2" acquired by "delete_volume" :: waited 0.070s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb3fc7a-d9c2-4f65-ac76-17d10aee03db]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:08 devstack sudo[84032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 Apr 27 23:52:08 devstack sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:08 devstack sudo[84030]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 1.241s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df8db9c9-6622-468f-ada3-9d9f4a6149da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:52:08 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa50c5f8-6780-40de-829c-e99475842eb4]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:08 devstack sudo[84039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da Apr 27 23:52:08 devstack sudo[84039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:08 devstack sudo[84032]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2" returned: 0 in 1.177s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:09 devstack sudo[84043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2 Apr 27 23:52:09 devstack sudo[84043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:09 devstack sudo[84039]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da" returned: 0 in 0.996s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:09 devstack sudo[84050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:52:09 devstack sudo[84050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:09 devstack sudo[84043]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9af56d29-5f26-47f8-bb0b-4f9b702541f2" returned: 0 in 0.836s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Lock "cinder-quobyte-9af56d29-5f26-47f8-bb0b-4f9b702541f2" released by "delete_volume" :: held 2.094s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:09 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Created reservations ['6abd7d96-06a1-43ea-b5a8-06409e456753', 'c5d55f12-00bd-4c9c-ba93-60a59572ce1b', '9010444d-5057-4664-a8ba-2e084c9e9b5d', 'c1959936-17b8-418d-9fab-833d9e7f3885'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:10 devstack sudo[84052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:10 devstack sudo[84052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:10 devstack sudo[84050]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 0.959s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:10 devstack sudo[84057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229 Apr 27 23:52:10 devstack sudo[84057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:10 devstack sudo[84052]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.818s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:10 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:10 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Deleted volume successfully. Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-488c3151-69aa-4dee-bea0-82ce52496325 tempest-VolumesTransfersTest-756308052 None] Lock "cinder-9af56d29-5f26-47f8-bb0b-4f9b702541f2-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:11 devstack sudo[84057]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da.bdbe3ae0-dcc4-4015-b81e-000b042b0229" returned: 0 in 1.070s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-quobyte-bdbe3ae0-dcc4-4015-b81e-000b042b0229" released by "_delete_snapshot" :: held 4.423s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" released by "delete_snapshot" :: held 4.460s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Flow 'volume_create_manager' (049f35af-1c18-42ea-9ea3-8236e52aa991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca65680f-ae4a-4f9d-82e6-925f76dea8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca65680f-ae4a-4f9d-82e6-925f76dea8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1595647823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142c53a0-beb6-477f-b701-de5b8852541a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3dd819cf1ea44599d1cffe6faa31cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:12Z,use_quota=True,user_id='267036bcc0bc467ea01a5c5ae93723fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b2da12-8594-45ac-800a-540e7e03657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b2da12-8594-45ac-800a-540e7e03657e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63f4471-2631-43b6-9fcf-0078cb629216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63f4471-2631-43b6-9fcf-0078cb629216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '142c53a0-beb6-477f-b701-de5b8852541a', 'volume_name': 'volume-142c53a0-beb6-477f-b701-de5b8852541a', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcc15d6-c3dc-4a82-af04-063270d658f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcc15d6-c3dc-4a82-af04-063270d658f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17f6fa0-612e-4c1b-af66-48a49b4a6b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:12 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Volume 142c53a0-beb6-477f-b701-de5b8852541a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-142c53a0-beb6-477f-b701-de5b8852541a', 'volume_size': 1} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1595647823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142c53a0-beb6-477f-b701-de5b8852541a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3dd819cf1ea44599d1cffe6faa31cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:12Z,use_quota=True,user_id='267036bcc0bc467ea01a5c5ae93723fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Creating volume 142c53a0-beb6-477f-b701-de5b8852541a {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:12 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Created reservations ['17525f58-1267-433a-9045-9ce45995af8b', '88c9c37a-c45e-4fd0-aad8-823843199b9c', 'd244ef93-dc8f-4637-9e31-9b05bf4906ee', '01ad42fc-f203-4ed9-b13a-ce5141a89a20'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:12 devstack sudo[84061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a 1073741824 Apr 27 23:52:12 devstack sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:12 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Delete snapshot completed successfully. Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6266cab-7430-473e-8a26-e0c14e04d99b tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-bdbe3ae0-dcc4-4015-b81e-000b042b0229-delete_snapshot" released by "delete_snapshot" :: held 4.859s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "cinder-df8db9c9-6622-468f-ada3-9d9f4a6149da-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-df8db9c9-6622-468f-ada3-9d9f4a6149da-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" acquired by "delete_volume" :: waited 0.038s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc08953a-4c81-413e-aede-42a91a1579e9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:13 devstack sudo[84061]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a 1073741824" returned: 0 in 1.055s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:13 devstack sudo[84069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a Apr 27 23:52:13 devstack sudo[84069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:13 devstack sudo[84067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da Apr 27 23:52:13 devstack sudo[84067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:13 devstack sudo[84069]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a" returned: 0 in 0.612s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17f6fa0-612e-4c1b-af66-48a49b4a6b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142c53a0-beb6-477f-b701-de5b8852541a', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6743e5d4-ec9d-4dcb-8242-5a8a7f1254ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:13 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Volume volume-142c53a0-beb6-477f-b701-de5b8852541a (142c53a0-beb6-477f-b701-de5b8852541a): created successfully Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6743e5d4-ec9d-4dcb-8242-5a8a7f1254ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:13 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Flow 'volume_create_manager' (049f35af-1c18-42ea-9ea3-8236e52aa991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:13 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2cefb3d0-c5b6-4ca8-9649-4a7cbb56861c tempest-VolumesTransfersTest-1224025689 None] Created volume successfully. Apr 27 23:52:14 devstack sudo[84067]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da" returned: 0 in 1.283s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:14 devstack sudo[84097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da Apr 27 23:52:14 devstack sudo[84097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Acquiring lock "cinder-142c53a0-beb6-477f-b701-de5b8852541a-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Lock "cinder-142c53a0-beb6-477f-b701-de5b8852541a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Acquiring lock "cinder-quobyte-142c53a0-beb6-477f-b701-de5b8852541a" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Lock "cinder-quobyte-142c53a0-beb6-477f-b701-de5b8852541a" acquired by "delete_volume" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:14 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[467042c7-7f2a-4706-8553-1b2b82427885]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:14 devstack sudo[84116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a Apr 27 23:52:14 devstack sudo[84116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:15 devstack sudo[84097]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-df8db9c9-6622-468f-ada3-9d9f4a6149da" returned: 0 in 0.734s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-quobyte-df8db9c9-6622-468f-ada3-9d9f4a6149da" released by "delete_volume" :: held 2.097s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Created reservations ['06e6bb7a-ce00-4faf-b937-ca2a3de65efe', '992fa765-cc26-4f84-9d93-b4f2465f62b0', '6c23d1bd-1d56-4fcd-82a4-84820588b29f', 'd213a439-97f6-4c3d-a67a-8ff48d009684'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:15 devstack sudo[84127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:15 devstack sudo[84127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:15 devstack sudo[84116]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a" returned: 0 in 0.688s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:15 devstack sudo[84132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a Apr 27 23:52:15 devstack sudo[84132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:15 devstack sudo[84127]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.693s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Deleted volume successfully. Apr 27 23:52:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0516b4a6-10c8-490a-9ed4-e6b56c4e05b1 tempest-SnapshotsActionsTest-230684663 None] Lock "cinder-df8db9c9-6622-468f-ada3-9d9f4a6149da-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:16 devstack sudo[84132]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-142c53a0-beb6-477f-b701-de5b8852541a" returned: 0 in 0.800s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:16 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Lock "cinder-quobyte-142c53a0-beb6-477f-b701-de5b8852541a" released by "delete_volume" :: held 1.536s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:16 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Created reservations ['36ab935a-7df5-4766-a280-f989624ba45f', '13230699-3af3-4cbe-83f8-22296d93a79f', 'e4d97462-e759-408a-820d-72ff297fb8cb', 'b493c1f5-8681-4db3-9f6c-f1599a75acb3'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:16 devstack sudo[84138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:16 devstack sudo[84138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:17 devstack sudo[84138]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.666s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:17 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:17 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Deleted volume successfully. Apr 27 23:52:17 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-45bec2a7-9634-457c-b734-ade585018273 tempest-VolumesTransfersTest-756308052 None] Lock "cinder-142c53a0-beb6-477f-b701-de5b8852541a-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (c6a7f057-9d2d-483f-b51b-b434238a5f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f23bfa-ce79-4dd4-94e7-a57048d498ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f23bfa-ce79-4dd4-94e7-a57048d498ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190933123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32cdc62-7609-45f3-9f05-55075deae34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:24Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a828b35-e8eb-4c16-ada6-443f5955acea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a828b35-e8eb-4c16-ada6-443f5955acea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e48d31-39ce-4c10-bb37-48fe79e5d2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e48d31-39ce-4c10-bb37-48fe79e5d2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b32cdc62-7609-45f3-9f05-55075deae34f', 'volume_name': 'volume-b32cdc62-7609-45f3-9f05-55075deae34f', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe33082-36e2-41c7-af13-2203dd73d1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe33082-36e2-41c7-af13-2203dd73d1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f75897-2bc2-42be-8a90-3c663cb97e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:23 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume b32cdc62-7609-45f3-9f05-55075deae34f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b32cdc62-7609-45f3-9f05-55075deae34f', 'volume_size': 1} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190933123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32cdc62-7609-45f3-9f05-55075deae34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:24Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Creating volume b32cdc62-7609-45f3-9f05-55075deae34f {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:23 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:24 devstack sudo[84206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f 1073741824 Apr 27 23:52:24 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Flow 'volume_create_manager' (062b7113-19d0-4c92-95a2-39396643baa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5506fa87-c676-4dcf-932b-e4eb73dc86af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5506fa87-c676-4dcf-932b-e4eb73dc86af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-195669167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd84eb7-9b16-4c03-b83b-390277eb3020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0e886cd0b84aa49eb5e516440a3f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:24Z,use_quota=True,user_id='18237d10add144e7ae2655b72fef2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc60ed0a-8ca6-4715-9d9b-fd0024a1dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc60ed0a-8ca6-4715-9d9b-fd0024a1dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532fceb1-733a-4113-8d21-f16356e25396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532fceb1-733a-4113-8d21-f16356e25396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd84eb7-9b16-4c03-b83b-390277eb3020', 'volume_name': 'volume-bcd84eb7-9b16-4c03-b83b-390277eb3020', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cdce90-d54f-4845-b982-25279083aee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cdce90-d54f-4845-b982-25279083aee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e6d823-8dd9-4292-8d2d-5dc45787d0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:24 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Volume bcd84eb7-9b16-4c03-b83b-390277eb3020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd84eb7-9b16-4c03-b83b-390277eb3020', 'volume_size': 1} Apr 27 23:52:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:25 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f 1073741824" returned: 0 in 1.064s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:25 devstack sudo[84215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f Apr 27 23:52:25 devstack sudo[84215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:25 devstack sudo[84215]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f" returned: 0 in 0.584s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-195669167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd84eb7-9b16-4c03-b83b-390277eb3020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0e886cd0b84aa49eb5e516440a3f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:24Z,use_quota=True,user_id='18237d10add144e7ae2655b72fef2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Creating volume bcd84eb7-9b16-4c03-b83b-390277eb3020 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:25 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f75897-2bc2-42be-8a90-3c663cb97e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32cdc62-7609-45f3-9f05-55075deae34f', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d068e2-5a32-4cf9-9f1b-9de39bab7f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:25 devstack sudo[84218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 1073741824 Apr 27 23:52:25 devstack sudo[84218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:25 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume volume-b32cdc62-7609-45f3-9f05-55075deae34f (b32cdc62-7609-45f3-9f05-55075deae34f): created successfully Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d068e2-5a32-4cf9-9f1b-9de39bab7f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (c6a7f057-9d2d-483f-b51b-b434238a5f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:25 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c5603e20-3e45-4038-899f-36219b2fa2ab tempest-CreateVolumesFromSnapshotTest-202710307 None] Created volume successfully. Apr 27 23:52:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:26 devstack sudo[84218]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 1073741824" returned: 0 in 1.255s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:27 devstack sudo[84224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 Apr 27 23:52:27 devstack sudo[84224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:27 devstack sudo[84224]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020" returned: 0 in 0.546s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.846s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e6d823-8dd9-4292-8d2d-5dc45787d0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd84eb7-9b16-4c03-b83b-390277eb3020', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e173a6-bc64-4eff-8c00-0b2dc973fa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Creating offline snapshot 86ff1ebb-f4d1-4d35-ba27-59d63b361691 of volume b32cdc62-7609-45f3-9f05-55075deae34f {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:52:27 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Volume volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 (bcd84eb7-9b16-4c03-b83b-390277eb3020): created successfully Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e173a6-bc64-4eff-8c00-0b2dc973fa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Flow 'volume_create_manager' (062b7113-19d0-4c92-95a2-39396643baa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe22b00c-edeb-41d4-b751-99b7f053a727]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:27 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cd4131a1-9943-49f8-8297-55877633a415 tempest-VolumeQuotasAdminTestJSON-1856200216 None] Created volume successfully. Apr 27 23:52:27 devstack sudo[84227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f Apr 27 23:52:27 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Flow 'volume_create_manager' (b7d4bdde-19fc-4767-8ff4-44a501ec8d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee2bd4c-cc9c-4e1a-ab3c-46fd25ed07e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee2bd4c-cc9c-4e1a-ab3c-46fd25ed07e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-879376753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347d773c-8257-47c7-b06a-ec00903650b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cca85df2af24d7db11e58cc4f421bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:28Z,use_quota=True,user_id='c68c868c1da14caf96d36e7e21447b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ddcfe5-fb98-4dc1-85ca-6469c34d3d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ddcfe5-fb98-4dc1-85ca-6469c34d3d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71935769-f057-419b-a10c-3925a3553d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71935769-f057-419b-a10c-3925a3553d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '347d773c-8257-47c7-b06a-ec00903650b9', 'volume_name': 'volume-347d773c-8257-47c7-b06a-ec00903650b9', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b752500-5809-4be0-ba68-12c887a63b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b752500-5809-4be0-ba68-12c887a63b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e5de7d-8113-43b8-bc4e-aaf992f76c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:27 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Volume 347d773c-8257-47c7-b06a-ec00903650b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-347d773c-8257-47c7-b06a-ec00903650b9', 'volume_size': 1} Apr 27 23:52:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:28 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f" returned: 0 in 0.755s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:28 devstack sudo[84244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 1G Apr 27 23:52:28 devstack sudo[84244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:28 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Acquiring lock "cinder-bcd84eb7-9b16-4c03-b83b-390277eb3020-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:28 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "cinder-bcd84eb7-9b16-4c03-b83b-390277eb3020-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:28 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Acquiring lock "cinder-quobyte-bcd84eb7-9b16-4c03-b83b-390277eb3020" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:28 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "cinder-quobyte-bcd84eb7-9b16-4c03-b83b-390277eb3020" acquired by "delete_volume" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:28 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab70f352-5286-4d18-ba4a-81207f6fd26e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:28 devstack sudo[84261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 Apr 27 23:52:28 devstack sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:29 devstack sudo[84244]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 1G" returned: 0 in 0.678s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32cdc62-7609-45f3-9f05-55075deae34f -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:29 devstack sudo[84269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32cdc62-7609-45f3-9f05-55075deae34f -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 Apr 27 23:52:29 devstack sudo[84269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:29 devstack sudo[84261]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020" returned: 0 in 0.574s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:29 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020 Apr 27 23:52:29 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:29 devstack sudo[84269]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32cdc62-7609-45f3-9f05-55075deae34f -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691" returned: 0 in 0.514s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:29 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 is being set with open permissions: ugo+rw Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:29 devstack sudo[84284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 Apr 27 23:52:29 devstack sudo[84284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:29 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bcd84eb7-9b16-4c03-b83b-390277eb3020" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "cinder-quobyte-bcd84eb7-9b16-4c03-b83b-390277eb3020" released by "delete_volume" :: held 1.150s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Created reservations ['d4a28fc4-53fd-49c4-8ea3-a6ad1815e7c4', '52431361-e716-4b5d-bcf9-aa841562e5df', '1608da30-162f-40a0-b7f5-01485ef2f053', '7de7ba51-a67e-4288-920a-fd79664b21a3'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:29 devstack sudo[84291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:29 devstack sudo[84291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:30 devstack sudo[84284]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691" returned: 0 in 0.511s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:30 devstack sudo[84298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.info Apr 27 23:52:30 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:30 devstack sudo[84291]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.444s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:30 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:30 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Deleted volume successfully. Apr 27 23:52:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ce3677f7-8e83-48a4-80f7-9d0a4d666dae tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "cinder-bcd84eb7-9b16-4c03-b83b-390277eb3020-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:30 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.info" returned: 0 in 0.637s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:30 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.info is being set with open permissions: ugo+rw Apr 27 23:52:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:30 devstack sudo[84318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.info Apr 27 23:52:30 devstack sudo[84318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:31 devstack sudo[84318]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.info" returned: 0 in 0.595s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.854s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.524s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-879376753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347d773c-8257-47c7-b06a-ec00903650b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cca85df2af24d7db11e58cc4f421bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:28Z,use_quota=True,user_id='c68c868c1da14caf96d36e7e21447b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Creating volume 347d773c-8257-47c7-b06a-ec00903650b9 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:31 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:31 devstack sudo[84333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9 1073741824 Apr 27 23:52:31 devstack sudo[84333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Flow 'volume_create_manager' (3e94c462-a43b-40a7-b3b0-ff26feb363bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd180a31-b914-4fca-b547-50428104aaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:31 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d8b9caba-02a5-4382-9e59-d125b9bb51ca tempest-CreateVolumesFromSnapshotTest-202710307 None] Create snapshot completed successfully Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd180a31-b914-4fca-b547-50428104aaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-224446511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ade6160-7aea-4399-81a1-9d47f0b3cac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0e886cd0b84aa49eb5e516440a3f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:31Z,use_quota=True,user_id='18237d10add144e7ae2655b72fef2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d91d4b9-ffc9-4013-9927-9f8a4bb57552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d91d4b9-ffc9-4013-9927-9f8a4bb57552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae502f3-9ae6-4e8e-a90f-3f701189c27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae502f3-9ae6-4e8e-a90f-3f701189c27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ade6160-7aea-4399-81a1-9d47f0b3cac3', 'volume_name': 'volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14868e61-0839-478e-8615-2d6f30baefc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14868e61-0839-478e-8615-2d6f30baefc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844ff9ef-7c66-4abc-bd91-8577a80442d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:31 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Volume 9ade6160-7aea-4399-81a1-9d47f0b3cac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3', 'volume_size': 1} Apr 27 23:52:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:32 devstack sudo[84333]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9 1073741824" returned: 0 in 0.915s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:32 devstack sudo[84340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9 Apr 27 23:52:32 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (7106cf7c-d5c2-46f2-a00c-0965a682b932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6244145b-b70d-4179-a56a-de65759d66cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6244145b-b70d-4179-a56a-de65759d66cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566218539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5527a68-902b-4d31-a706-0babf2cc24de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:32Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d2e768-a108-4d07-a982-ce1219158d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d2e768-a108-4d07-a982-ce1219158d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1cc5c9-3eed-49a6-b5e1-af0d2dd44cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1cc5c9-3eed-49a6-b5e1-af0d2dd44cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5527a68-902b-4d31-a706-0babf2cc24de', 'volume_name': 'volume-e5527a68-902b-4d31-a706-0babf2cc24de', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4246330-921c-4e46-a7bb-8b02406fc877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4246330-921c-4e46-a7bb-8b02406fc877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6d122f-8ad7-43ec-a7a5-15d86e10fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume e5527a68-902b-4d31-a706-0babf2cc24de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5527a68-902b-4d31-a706-0babf2cc24de', 'volume_size': 1} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (93a7a2aa-c16f-4250-881e-54a0e25a724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8dc2f-fbfc-4012-822f-00fe3d792d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8dc2f-fbfc-4012-822f-00fe3d792d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343892217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a2fb8a-de68-49b4-a38b-bec7694ce4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:33Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640ee6cc-cc21-4b05-bea7-1fe4bcafeb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640ee6cc-cc21-4b05-bea7-1fe4bcafeb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec8f196-8f42-4c58-b98d-78ca1f943db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec8f196-8f42-4c58-b98d-78ca1f943db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a2fb8a-de68-49b4-a38b-bec7694ce4b7', 'volume_name': 'volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba698c77-97b3-42ea-a4ec-6573d2073895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba698c77-97b3-42ea-a4ec-6573d2073895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abed6eee-2288-419e-b3d2-66fd072e3344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:32 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume 52a2fb8a-de68-49b4-a38b-bec7694ce4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7', 'volume_size': 1} Apr 27 23:52:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:33 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9" returned: 0 in 0.826s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.670s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-224446511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ade6160-7aea-4399-81a1-9d47f0b3cac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0e886cd0b84aa49eb5e516440a3f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:31Z,use_quota=True,user_id='18237d10add144e7ae2655b72fef2517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Creating volume 9ade6160-7aea-4399-81a1-9d47f0b3cac3 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:33 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (51b5d536-8c41-45d9-96e2-ef3b3f45cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:33 devstack sudo[84344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 1073741824 Apr 27 23:52:33 devstack sudo[84344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27df8db-c746-46a2-8130-2a68a15c7576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27df8db-c746-46a2-8130-2a68a15c7576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637852806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a02f5c-f4ec-4560-827e-d0c2691703a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:33Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a4a880-0ecb-435e-bfee-16735f6704f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a4a880-0ecb-435e-bfee-16735f6704f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3bf161-46e8-4336-b205-b2d6539123f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3bf161-46e8-4336-b205-b2d6539123f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a02f5c-f4ec-4560-827e-d0c2691703a4', 'volume_name': 'volume-37a02f5c-f4ec-4560-827e-d0c2691703a4', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb68440-acac-45fa-9d4a-dac260593307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb68440-acac-45fa-9d4a-dac260593307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1842b65b-d944-4fe0-829e-8e930d9c132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume 37a02f5c-f4ec-4560-827e-d0c2691703a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a02f5c-f4ec-4560-827e-d0c2691703a4', 'volume_size': 1} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e5de7d-8113-43b8-bc4e-aaf992f76c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-347d773c-8257-47c7-b06a-ec00903650b9', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0f6951-fdde-4ada-a7a8-25955658d1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Volume volume-347d773c-8257-47c7-b06a-ec00903650b9 (347d773c-8257-47c7-b06a-ec00903650b9): created successfully Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0f6951-fdde-4ada-a7a8-25955658d1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Flow 'volume_create_manager' (b7d4bdde-19fc-4767-8ff4-44a501ec8d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:33 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7ad092e2-330b-493a-80b8-9bed4f52a4cd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Created volume successfully. Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (6b590994-2fb0-450e-a24a-5b329b18b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a25704-b5c1-4efb-9435-0afc85ffc5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a25704-b5c1-4efb-9435-0afc85ffc5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609819272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd65527-a89c-4799-bce7-5298a2699343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:34Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e06d9bc-f794-4577-9375-8b1b87d2ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e06d9bc-f794-4577-9375-8b1b87d2ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494bc658-d5a3-472f-9c45-a89f2242c8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494bc658-d5a3-472f-9c45-a89f2242c8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd65527-a89c-4799-bce7-5298a2699343', 'volume_name': 'volume-3cd65527-a89c-4799-bce7-5298a2699343', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c6e09a-ea2e-437d-8343-7d7e5d55a01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c6e09a-ea2e-437d-8343-7d7e5d55a01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58261db9-2671-4045-8f01-0712a96b8307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:33 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume 3cd65527-a89c-4799-bce7-5298a2699343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd65527-a89c-4799-bce7-5298a2699343', 'volume_size': 1} Apr 27 23:52:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:34 devstack sudo[84344]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 1073741824" returned: 0 in 0.992s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (d70b47dd-2f23-43c0-9893-b189426d37f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747aafa4-2801-4ef1-9cad-98b8ed4d5718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:34 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 Apr 27 23:52:34 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747aafa4-2801-4ef1-9cad-98b8ed4d5718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-732534230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1934c90e-96ce-4583-8828-2a36a70a4c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:34Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a20744-6fb6-41a2-9449-7a2d05bc6e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a20744-6fb6-41a2-9449-7a2d05bc6e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5d4bf3-bc82-4aba-84dd-c87c4ffef1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5d4bf3-bc82-4aba-84dd-c87c4ffef1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1934c90e-96ce-4583-8828-2a36a70a4c7f', 'volume_name': 'volume-1934c90e-96ce-4583-8828-2a36a70a4c7f', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0916e232-74c1-46d2-97ee-8a071fe53139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0916e232-74c1-46d2-97ee-8a071fe53139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b7fcbd-0847-41fc-bba7-96055657f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:34 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume 1934c90e-96ce-4583-8828-2a36a70a4c7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1934c90e-96ce-4583-8828-2a36a70a4c7f', 'volume_size': 1} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:34 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3" returned: 0 in 0.586s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566218539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5527a68-902b-4d31-a706-0babf2cc24de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:32Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Creating volume e5527a68-902b-4d31-a706-0babf2cc24de {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:34 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:34 devstack sudo[84387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de 1073741824 Apr 27 23:52:34 devstack sudo[84387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844ff9ef-7c66-4abc-bd91-8577a80442d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64c62fa-33be-4985-96fc-0b57c9983460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:34 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Volume volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 (9ade6160-7aea-4399-81a1-9d47f0b3cac3): created successfully Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64c62fa-33be-4985-96fc-0b57c9983460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Flow 'volume_create_manager' (3e94c462-a43b-40a7-b3b0-ff26feb363bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-15962201-467f-4743-b8e1-32315eaefdee tempest-VolumeQuotasAdminTestJSON-1856200216 None] Created volume successfully. Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Acquiring lock "cinder-347d773c-8257-47c7-b06a-ec00903650b9-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "cinder-347d773c-8257-47c7-b06a-ec00903650b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Acquiring lock "cinder-quobyte-347d773c-8257-47c7-b06a-ec00903650b9" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "cinder-quobyte-347d773c-8257-47c7-b06a-ec00903650b9" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e02e866-b07f-47d6-a7e4-756d58a64028]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:35 devstack sudo[84390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9 Apr 27 23:52:35 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:35 devstack sudo[84387]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de 1073741824" returned: 0 in 0.725s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:35 devstack sudo[84427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de Apr 27 23:52:35 devstack sudo[84427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:35 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9" returned: 0 in 0.709s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:36 devstack sudo[84435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9 Apr 27 23:52:36 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:36 devstack sudo[84427]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de" returned: 0 in 0.563s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.315s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343892217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a2fb8a-de68-49b4-a38b-bec7694ce4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:33Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Creating volume 52a2fb8a-de68-49b4-a38b-bec7694ce4b7 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:36 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6d122f-8ad7-43ec-a7a5-15d86e10fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5527a68-902b-4d31-a706-0babf2cc24de', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:36 devstack sudo[84438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 1073741824 Apr 27 23:52:36 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998300ef-5c1c-48bd-88e1-3c7a548e98e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:36 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume volume-e5527a68-902b-4d31-a706-0babf2cc24de (e5527a68-902b-4d31-a706-0babf2cc24de): created successfully Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998300ef-5c1c-48bd-88e1-3c7a548e98e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (7106cf7c-d5c2-46f2-a00c-0965a682b932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b240cd94-9324-416c-9756-2df7d755c4d4 tempest-CreateVolumesFromSnapshotTest-202710307 None] Created volume successfully. Apr 27 23:52:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-942b1610-3c50-44c2-8732-63becb4d3811 tempest-VolumeQuotasAdminTestJSON-2038867223 None] Transfer volume completed successfully. Apr 27 23:52:36 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-347d773c-8257-47c7-b06a-ec00903650b9" returned: 0 in 0.562s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "cinder-quobyte-347d773c-8257-47c7-b06a-ec00903650b9" released by "delete_volume" :: held 1.312s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Created reservations ['cff03983-5bfa-4fa9-95c0-8d576164dc32', 'd2689df5-acc5-4897-a4f8-332205e23bd1', '0bb1883f-88fe-40d4-a102-0bd145077c1c', '31a277a4-e596-4089-817c-d84284190177'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:36 devstack sudo[84441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:36 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-6972b87f-4036-408f-8307-c49e376d0fba req-589d4a82-7bde-4b63-a168-cff8e58b1585 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Terminate volume connection completed successfully. Apr 27 23:52:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-6972b87f-4036-408f-8307-c49e376d0fba req-589d4a82-7bde-4b63-a168-cff8e58b1585 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Deleting attachment b0a58d2e-3ffd-49ca-ab26-3e5f4446011a. {{(pid=81312) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 27 23:52:37 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 1073741824" returned: 0 in 0.743s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:37 devstack sudo[84447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 Apr 27 23:52:37 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:37 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.506s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:37 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Deleted volume successfully. Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-217cd024-afe7-4a27-9984-f7e85263affd tempest-VolumeQuotasNegativeTestJSON-1716966215 None] Lock "cinder-347d773c-8257-47c7-b06a-ec00903650b9-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Acquiring lock "cinder-9ade6160-7aea-4399-81a1-9d47f0b3cac3-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Lock "cinder-9ade6160-7aea-4399-81a1-9d47f0b3cac3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Acquiring lock "cinder-quobyte-9ade6160-7aea-4399-81a1-9d47f0b3cac3" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Lock "cinder-quobyte-9ade6160-7aea-4399-81a1-9d47f0b3cac3" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2f280e-43eb-4eaf-8d2e-d8648170368c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:37 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.238s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637852806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a02f5c-f4ec-4560-827e-d0c2691703a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:33Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Creating volume 37a02f5c-f4ec-4560-827e-d0c2691703a4 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:37 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:37 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 Apr 27 23:52:37 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "cinder-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abed6eee-2288-419e-b3d2-66fd072e3344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:37 devstack sudo[84452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 1073741824 Apr 27 23:52:37 devstack sudo[84452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4274f362-d60b-40bb-a310-b08eb02136aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:37 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 (52a2fb8a-de68-49b4-a38b-bec7694ce4b7): created successfully Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4274f362-d60b-40bb-a310-b08eb02136aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (93a7a2aa-c16f-4250-881e-54a0e25a724c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "cinder-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:37 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7b6a1834-fc67-403e-bed3-4c4b2a410022 tempest-CreateVolumesFromSnapshotTest-202710307 None] Created volume successfully. Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "cinder-quobyte-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "cinder-quobyte-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" acquired by "delete_volume" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65587b6-0bdf-4751-b1e0-c7cc11437553]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:38 devstack sudo[84455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b Apr 27 23:52:38 devstack sudo[84455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:38 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3" returned: 0 in 0.842s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:38 devstack sudo[84464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3 Apr 27 23:52:38 devstack sudo[84464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:38 devstack sudo[84452]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 1073741824" returned: 0 in 0.828s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:38 devstack sudo[84468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 Apr 27 23:52:38 devstack sudo[84468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:38 devstack sudo[84455]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" returned: 0 in 0.667s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:38 devstack sudo[84470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b Apr 27 23:52:38 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:39 devstack sudo[84464]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ade6160-7aea-4399-81a1-9d47f0b3cac3" returned: 0 in 0.636s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Lock "cinder-quobyte-9ade6160-7aea-4399-81a1-9d47f0b3cac3" released by "delete_volume" :: held 1.537s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Created reservations ['6d92d4ee-bd3c-45ce-9a79-22331896bc74', '4e97b660-7720-40d2-961c-8e26b84ad461', '117a2a21-d714-499c-8b46-7ba26932f556', 'd9816343-7289-44dc-8fcd-cdc948ab84e8'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:39 devstack sudo[84476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:39 devstack sudo[84476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:39 devstack sudo[84468]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4" returned: 0 in 0.728s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.487s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609819272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd65527-a89c-4799-bce7-5298a2699343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:34Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Creating volume 3cd65527-a89c-4799-bce7-5298a2699343 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:39 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1842b65b-d944-4fe0-829e-8e930d9c132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a02f5c-f4ec-4560-827e-d0c2691703a4', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b80c37-aabd-4001-a29a-fa88e6c0555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:39 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 (37a02f5c-f4ec-4560-827e-d0c2691703a4): created successfully Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b80c37-aabd-4001-a29a-fa88e6c0555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (51b5d536-8c41-45d9-96e2-ef3b3f45cd11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:39 devstack sudo[84481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343 1073741824 Apr 27 23:52:39 devstack sudo[84481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:39 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b94d0ce3-7ff4-4896-95b4-0b67fe0407e8 tempest-CreateVolumesFromSnapshotTest-202710307 None] Created volume successfully. Apr 27 23:52:39 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" returned: 1 in 0.783s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:39 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b Apr 27 23:52:39 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:39 devstack sudo[84476]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.672s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:39 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Deleted volume successfully. Apr 27 23:52:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69eda6a1-b499-4fa0-bff2-7fa15152bfff tempest-VolumeQuotasAdminTestJSON-1864919832 None] Lock "cinder-9ade6160-7aea-4399-81a1-9d47f0b3cac3-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:40 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" returned: 0 in 0.817s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:40 devstack sudo[84481]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343 1073741824" returned: 0 in 0.930s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "cinder-quobyte-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b" released by "delete_volume" :: held 2.357s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:40 devstack sudo[84490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343 Apr 27 23:52:40 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG cinder.quota [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Created reservations ['1f1b2742-90f6-48f0-a066-8b7f0dc26920', '8bf3eaae-613e-42ae-bc8a-a6f58dc8b583', '55dfa3f3-5d13-41bf-9613-7f648d2f83a9', 'b40e5a7e-e2f9-4e3a-8c97-151f74ef9af8'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:40 devstack sudo[84492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:40 devstack sudo[84492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:41 devstack sudo[84492]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.733s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.manager [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:41 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Deleted volume successfully. Apr 27 23:52:41 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343" returned: 0 in 0.936s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-6972b87f-4036-408f-8307-c49e376d0fba req-5b069a45-7e49-423b-9bc0-76e31d7a3eca tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "cinder-b7af2aa6-9297-4cb3-8462-e99cc31a7a6b-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.818s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-732534230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1934c90e-96ce-4583-8828-2a36a70a4c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c754c2214d4081a1cba63ef5c65342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:34Z,use_quota=True,user_id='e69a63f4ac89422fbed0928bffb0a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Creating volume 1934c90e-96ce-4583-8828-2a36a70a4c7f {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:41 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58261db9-2671-4045-8f01-0712a96b8307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd65527-a89c-4799-bce7-5298a2699343', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d29bf50-2a15-4c29-85f4-3bab9b8deff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:41 devstack sudo[84497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f 1073741824 Apr 27 23:52:41 devstack sudo[84497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:41 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume volume-3cd65527-a89c-4799-bce7-5298a2699343 (3cd65527-a89c-4799-bce7-5298a2699343): created successfully Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d29bf50-2a15-4c29-85f4-3bab9b8deff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (6b590994-2fb0-450e-a24a-5b329b18b63a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:41 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f970a93f-8147-4924-92c4-d5a3a1900808 tempest-CreateVolumesFromSnapshotTest-202710307 None] Created volume successfully. Apr 27 23:52:42 devstack sudo[84497]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f 1073741824" returned: 0 in 0.843s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:42 devstack sudo[84511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f Apr 27 23:52:42 devstack sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:42 devstack sudo[84511]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f" returned: 0 in 0.748s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b7fcbd-0847-41fc-bba7-96055657f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1934c90e-96ce-4583-8828-2a36a70a4c7f', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa384cbd-991a-432f-b07e-d301398affa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:42 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Volume volume-1934c90e-96ce-4583-8828-2a36a70a4c7f (1934c90e-96ce-4583-8828-2a36a70a4c7f): created successfully Apr 27 23:52:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa384cbd-991a-432f-b07e-d301398affa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Flow 'volume_create_manager' (d70b47dd-2f23-43c0-9893-b189426d37f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:42 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5aa22796-6b3c-40e0-86c4-a16d3dbc556e tempest-CreateVolumesFromSnapshotTest-202710307 None] Created volume successfully. Apr 27 23:52:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-1934c90e-96ce-4583-8828-2a36a70a4c7f-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-1934c90e-96ce-4583-8828-2a36a70a4c7f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-quobyte-1934c90e-96ce-4583-8828-2a36a70a4c7f" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-1934c90e-96ce-4583-8828-2a36a70a4c7f" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:43 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d9e694-4385-42d7-a8e0-932d7cb72452]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:43 devstack sudo[84536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f Apr 27 23:52:43 devstack sudo[84536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:44 devstack sudo[84536]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f" returned: 0 in 0.718s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:44 devstack sudo[84541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f Apr 27 23:52:44 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:44 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Flow 'volume_create_manager' (459e4cc5-a62b-4d64-ac19-bb6ef8d92ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4f81ef-7007-4137-be9f-fcf19f4fc15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:45 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4f81ef-7007-4137-be9f-fcf19f4fc15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-899398606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40808180-e870-45c9-ae06-5a7ebec9a96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd27e3f8ccd4fe8b02b03b866aace5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:45Z,use_quota=True,user_id='6cf33af929414f1e94d7d6c94ff044c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0f2537d-4e64-400b-92ce-a8e064dee748),volume_type_id=e0f2537d-4e64-400b-92ce-a8e064dee748)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20865fd-20d8-4822-81ec-f85a696015a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20865fd-20d8-4822-81ec-f85a696015a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dfbd98-5952-4611-a22e-fa1395affbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dfbd98-5952-4611-a22e-fa1395affbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40808180-e870-45c9-ae06-5a7ebec9a96e', 'volume_name': 'volume-40808180-e870-45c9-ae06-5a7ebec9a96e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:45 devstack sudo[84546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154a8a65-b966-4be2-bc89-73912a714bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:45 devstack sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154a8a65-b966-4be2-bc89-73912a714bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718d50ec-64e9-4a22-8d74-a1aebc32fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:45 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Volume 40808180-e870-45c9-ae06-5a7ebec9a96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40808180-e870-45c9-ae06-5a7ebec9a96e', 'volume_size': 1} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-899398606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40808180-e870-45c9-ae06-5a7ebec9a96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd27e3f8ccd4fe8b02b03b866aace5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:45Z,use_quota=True,user_id='6cf33af929414f1e94d7d6c94ff044c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0f2537d-4e64-400b-92ce-a8e064dee748),volume_type_id=e0f2537d-4e64-400b-92ce-a8e064dee748)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Creating volume 40808180-e870-45c9-ae06-5a7ebec9a96e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:45 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1934c90e-96ce-4583-8828-2a36a70a4c7f" returned: 0 in 0.781s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-1934c90e-96ce-4583-8828-2a36a70a4c7f" released by "delete_volume" :: held 1.564s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:45 devstack sudo[84548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e 1073741824 Apr 27 23:52:45 devstack sudo[84548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Created reservations ['ec2bec1c-f1e6-46b7-94f2-36efafbf9c57', 'e42b50c6-f269-45ec-b62f-b4b6aa36dd07', 'a9d9a82e-f57a-47a7-a279-10204e3f19e3', '2d7319dc-9893-416e-bf75-47ae4f509c19'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:45 devstack sudo[84550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:45 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:45 devstack sudo[84546]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.500s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-3cd65527-a89c-4799-bce7-5298a2699343-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-3cd65527-a89c-4799-bce7-5298a2699343-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-quobyte-3cd65527-a89c-4799-bce7-5298a2699343" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-3cd65527-a89c-4799-bce7-5298a2699343" acquired by "delete_volume" :: waited 0.038s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:45 devstack sudo[84548]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e 1073741824" returned: 0 in 0.829s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a62f78-9d65-4ad0-b1b8-ba09cab16de6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:46 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.724s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:46 devstack sudo[84558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e Apr 27 23:52:46 devstack sudo[84558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:46 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Deleted volume successfully. Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3eebda25-cfab-44c1-8a25-4eb64f78d0f7 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-1934c90e-96ce-4583-8828-2a36a70a4c7f-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:46 devstack sudo[84557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343 Apr 27 23:52:46 devstack sudo[84557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:46 devstack sudo[84558]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e" returned: 0 in 0.531s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718d50ec-64e9-4a22-8d74-a1aebc32fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40808180-e870-45c9-ae06-5a7ebec9a96e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ef1b02-e4e6-4966-8b29-13f4c030d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:46 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Volume volume-40808180-e870-45c9-ae06-5a7ebec9a96e (40808180-e870-45c9-ae06-5a7ebec9a96e): created successfully Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ef1b02-e4e6-4966-8b29-13f4c030d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:46 devstack sudo[84557]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Flow 'volume_create_manager' (459e4cc5-a62b-4d64-ac19-bb6ef8d92ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343" returned: 0 in 0.628s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:46 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-8780c8be-2416-4f43-83ab-0f7a70856bb4 tempest-VolumeTypesAccessTest-1981868777 None] Created volume successfully. Apr 27 23:52:46 devstack sudo[84565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343 Apr 27 23:52:46 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Acquiring lock "cinder-40808180-e870-45c9-ae06-5a7ebec9a96e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:47 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3cd65527-a89c-4799-bce7-5298a2699343" returned: 0 in 0.584s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Lock "cinder-40808180-e870-45c9-ae06-5a7ebec9a96e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-3cd65527-a89c-4799-bce7-5298a2699343" released by "delete_volume" :: held 1.273s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Acquiring lock "cinder-quobyte-40808180-e870-45c9-ae06-5a7ebec9a96e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Lock "cinder-quobyte-40808180-e870-45c9-ae06-5a7ebec9a96e" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef37455-23b1-4bb0-a3d3-128f8976c821]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Created reservations ['5bcd9be0-61fe-4a81-a939-6a5605ff6016', 'd7ea06bc-c6a6-4ac2-933c-69cb177c8f83', 'a572baaa-3515-4337-8ee4-09e90e26e15c', '748ff7ae-3baf-4d40-ac57-d37bdabe7dec'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:47 devstack sudo[84569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e Apr 27 23:52:47 devstack sudo[84569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:47 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:47 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:47 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.527s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:47 devstack sudo[84569]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:47 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Deleted volume successfully. Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e" returned: 0 in 0.631s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c7150b42-ad14-4824-bead-675aeba7b14e tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-3cd65527-a89c-4799-bce7-5298a2699343-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:47 devstack sudo[84578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e Apr 27 23:52:47 devstack sudo[84578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-37a02f5c-f4ec-4560-827e-d0c2691703a4-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-37a02f5c-f4ec-4560-827e-d0c2691703a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-quobyte-37a02f5c-f4ec-4560-827e-d0c2691703a4" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-37a02f5c-f4ec-4560-827e-d0c2691703a4" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[814182bb-ba66-40e7-ac0d-c655ac2e979e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:48 devstack sudo[84580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 Apr 27 23:52:48 devstack sudo[84580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Flow 'volume_create_manager' (a560e0f1-21d8-499e-b3e1-d4dd9ce6406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a92c6f1-62a4-4655-a035-39da3814e00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a92c6f1-62a4-4655-a035-39da3814e00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1928796702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a885b3b3-1377-4dab-b5d7-ee9bc192315e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4423eb6a054408882f3eab9ee529efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:48Z,use_quota=True,user_id='44b7ca108f7c4f5e88b96a56b4956595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76136d9c-508f-42ab-8c72-95dcd707d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76136d9c-508f-42ab-8c72-95dcd707d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c0f0c3-0ea5-4184-8db1-3c8e53dd0b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c0f0c3-0ea5-4184-8db1-3c8e53dd0b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a885b3b3-1377-4dab-b5d7-ee9bc192315e', 'volume_name': 'volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2594f1-b7ca-4910-aad6-564c17b27c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2594f1-b7ca-4910-aad6-564c17b27c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adef04d4-fc83-48a9-84a8-74ab166e00b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:48 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Volume a885b3b3-1377-4dab-b5d7-ee9bc192315e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e', 'volume_size': 1} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1928796702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a885b3b3-1377-4dab-b5d7-ee9bc192315e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4423eb6a054408882f3eab9ee529efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:48Z,use_quota=True,user_id='44b7ca108f7c4f5e88b96a56b4956595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Creating volume a885b3b3-1377-4dab-b5d7-ee9bc192315e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:48 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:48 devstack sudo[84578]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-40808180-e870-45c9-ae06-5a7ebec9a96e" returned: 0 in 0.622s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:48 devstack sudo[84583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e 1073741824 Apr 27 23:52:48 devstack sudo[84583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Lock "cinder-quobyte-40808180-e870-45c9-ae06-5a7ebec9a96e" released by "delete_volume" :: held 1.310s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:48 devstack cinder-volume[81312]: WARNING cinder.quota [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1653318091 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1653318091, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:52:48 devstack cinder-volume[81312]: WARNING cinder.quota [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1653318091 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1653318091, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Created reservations ['7a799c29-8c07-41d8-8b03-fb1d9297ebcc', '6c52be7d-9108-4a85-a0b3-824fd1acc8e9', 'b6d6ab4c-74cf-4ce7-b329-71a5fbc0e52b', 'c329cef6-5ef1-4ae5-a4b7-95c688148688'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:48 devstack sudo[84585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:48 devstack sudo[84585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:48 devstack sudo[84580]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4" returned: 0 in 0.584s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:48 devstack sudo[84590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4 Apr 27 23:52:48 devstack sudo[84590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:49 devstack sudo[84583]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e 1073741824" returned: 0 in 0.634s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:49 devstack sudo[84585]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.535s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:49 devstack sudo[84598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e Apr 27 23:52:49 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:49 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Deleted volume successfully. Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-aa2b5beb-9932-444d-9cd0-1037353b31cf tempest-VolumeTypesAccessTest-1981868777 None] Lock "cinder-40808180-e870-45c9-ae06-5a7ebec9a96e-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:49 devstack sudo[84590]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-37a02f5c-f4ec-4560-827e-d0c2691703a4" returned: 0 in 0.552s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-37a02f5c-f4ec-4560-827e-d0c2691703a4" released by "delete_volume" :: held 1.205s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Created reservations ['27f47686-6a99-422f-afe0-c45737fba8e1', 'f0747367-c127-4370-842e-dbd2a5ecc027', 'c3318cf0-2206-47b9-af44-c5c74af36d9e', '9aadb094-84d3-4259-a95a-70c43147e131'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:49 devstack sudo[84602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:49 devstack sudo[84602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:49 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e" returned: 0 in 0.521s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adef04d4-fc83-48a9-84a8-74ab166e00b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bafce96-77cd-447b-a770-7b230a177e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:49 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Volume volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e (a885b3b3-1377-4dab-b5d7-ee9bc192315e): created successfully Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bafce96-77cd-447b-a770-7b230a177e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Flow 'volume_create_manager' (a560e0f1-21d8-499e-b3e1-d4dd9ce6406d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:49 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-643fb0c7-ce21-479c-ab56-d4e43e90e789 tempest-VolumesServicesTestJSON-699413462 None] Created volume successfully. Apr 27 23:52:50 devstack sudo[84602]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.518s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:50 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Deleted volume successfully. Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd80691c-3f93-4835-9e53-cef7c1cb37e5 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-37a02f5c-f4ec-4560-827e-d0c2691703a4-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-52a2fb8a-de68-49b4-a38b-bec7694ce4b7-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-52a2fb8a-de68-49b4-a38b-bec7694ce4b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-quobyte-52a2fb8a-de68-49b4-a38b-bec7694ce4b7" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-52a2fb8a-de68-49b4-a38b-bec7694ce4b7" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aefde3-4742-4052-a789-b9b91cbab59c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:50 devstack sudo[84605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 Apr 27 23:52:50 devstack sudo[84605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Acquiring lock "cinder-a885b3b3-1377-4dab-b5d7-ee9bc192315e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Lock "cinder-a885b3b3-1377-4dab-b5d7-ee9bc192315e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Acquiring lock "cinder-quobyte-a885b3b3-1377-4dab-b5d7-ee9bc192315e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Lock "cinder-quobyte-a885b3b3-1377-4dab-b5d7-ee9bc192315e" acquired by "delete_volume" :: waited 0.034s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe436e01-26ff-453c-bce4-f4a5da625651]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:51 devstack sudo[84624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e Apr 27 23:52:51 devstack sudo[84624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:51 devstack sudo[84605]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7" returned: 0 in 0.861s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:51 devstack sudo[84638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7 Apr 27 23:52:51 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:51 devstack sudo[84624]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e" returned: 0 in 0.780s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:51 devstack sudo[84645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e Apr 27 23:52:51 devstack sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:52 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-52a2fb8a-de68-49b4-a38b-bec7694ce4b7" returned: 0 in 0.622s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-52a2fb8a-de68-49b4-a38b-bec7694ce4b7" released by "delete_volume" :: held 1.533s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Created reservations ['e6e6f198-87b7-4682-91ca-e388270b89bf', '4e7b4277-b1c0-4752-8963-4036a4ebc8bb', '9b11f0e4-5217-4f93-9893-af211f408d65', '43ac5689-f8cf-47b1-ad16-59e97199db4e'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:52 devstack sudo[84648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:52 devstack sudo[84648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:52 devstack sudo[84645]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a885b3b3-1377-4dab-b5d7-ee9bc192315e" returned: 0 in 0.661s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Lock "cinder-quobyte-a885b3b3-1377-4dab-b5d7-ee9bc192315e" released by "delete_volume" :: held 1.506s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Created reservations ['e24cbb3a-80d7-4a02-bee2-62dda5cb0b6b', '34fa1065-e360-4dc5-a72f-96b9b96bcb68', 'd5e82123-46d9-4c07-bc8f-ef64c203cc2c', 'e83c2f50-4c5f-4306-876a-0d91d1233d7f'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-e5527a68-902b-4d31-a706-0babf2cc24de-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:52 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:52 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:52 devstack sudo[84648]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-e5527a68-902b-4d31-a706-0babf2cc24de-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.649s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:52 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Deleted volume successfully. Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-quobyte-e5527a68-902b-4d31-a706-0babf2cc24de" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5fa955d9-0703-4874-975a-1ba8dadc3564 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-52a2fb8a-de68-49b4-a38b-bec7694ce4b7-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-e5527a68-902b-4d31-a706-0babf2cc24de" acquired by "delete_volume" :: waited 0.046s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea85e4c6-e079-463d-a4af-74dd41fc4901]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:53 devstack sudo[84657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de Apr 27 23:52:53 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:53 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.665s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:53 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Deleted volume successfully. Apr 27 23:52:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3dd293b-8e2c-4dcd-9a76-16582b57c619 tempest-VolumesServicesTestJSON-699413462 None] Lock "cinder-a885b3b3-1377-4dab-b5d7-ee9bc192315e-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:53 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de" returned: 0 in 0.673s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:53 devstack sudo[84664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de Apr 27 23:52:53 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-a9a836da-2bdc-4eb8-93ea-1bf39d052eb6 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Terminate volume connection completed successfully. Apr 27 23:52:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-a9a836da-2bdc-4eb8-93ea-1bf39d052eb6 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Deleting attachment 94aba7cc-2e6a-40a1-bf10-013b0c132f41. {{(pid=81312) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 27 23:52:54 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e5527a68-902b-4d31-a706-0babf2cc24de" returned: 0 in 0.533s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-e5527a68-902b-4d31-a706-0babf2cc24de" released by "delete_volume" :: held 1.272s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Created reservations ['8533fde9-8daf-44df-ad91-5aa621bf0cd4', 'c1abe111-4938-43ee-9baf-d82bbecf15e1', '56b667cd-6578-4f2f-ac94-7657093ebdfb', 'd73b3db3-214c-4114-b770-b6c5b20faf41'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:54 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:54 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "cinder-d602e579-efd7-446c-9325-18e0e96913a4-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "cinder-d602e579-efd7-446c-9325-18e0e96913a4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "cinder-quobyte-d602e579-efd7-446c-9325-18e0e96913a4" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "cinder-quobyte-d602e579-efd7-446c-9325-18e0e96913a4" acquired by "delete_volume" :: waited 0.036s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6481d3e5-ecdd-4a31-80c3-99e1610897f5]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:54 devstack sudo[84669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 Apr 27 23:52:54 devstack sudo[84669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:54 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.594s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:54 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:54 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Deleted volume successfully. Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1ac25a84-60cf-432b-ba49-81253ec40d90 tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-e5527a68-902b-4d31-a706-0babf2cc24de-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-86ff1ebb-f4d1-4d35-ba27-59d63b361691-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-86ff1ebb-f4d1-4d35-ba27-59d63b361691-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-quobyte-b32cdc62-7609-45f3-9f05-55075deae34f" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-b32cdc62-7609-45f3-9f05-55075deae34f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-quobyte-86ff1ebb-f4d1-4d35-ba27-59d63b361691" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-86ff1ebb-f4d1-4d35-ba27-59d63b361691" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Deleting offline snapshot 86ff1ebb-f4d1-4d35-ba27-59d63b361691 of volume b32cdc62-7609-45f3-9f05-55075deae34f {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] snapshot_file for this snap is: volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b0aaf1-95f1-4bc9-9ca8-cbfae91feaed]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:55 devstack sudo[84672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 Apr 27 23:52:55 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:55 devstack sudo[84669]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4" returned: 0 in 0.867s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:55 devstack sudo[84677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4 Apr 27 23:52:55 devstack sudo[84677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:56 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691" returned: 0 in 0.866s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b32cdc62-7609-45f3-9f05-55075deae34f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc1f057-3564-47f9-a055-5e4ae10a25b1]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:56 devstack sudo[84682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f Apr 27 23:52:56 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:56 devstack sudo[84677]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d602e579-efd7-446c-9325-18e0e96913a4" returned: 0 in 0.630s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "cinder-quobyte-d602e579-efd7-446c-9325-18e0e96913a4" released by "delete_volume" :: held 1.548s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG cinder.quota [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Created reservations ['b92b950b-2702-43d2-98c7-416f31eeabea', 'f25da799-2e94-4488-b8c9-61a3ea76b611', '78bd0bcc-c833-42ce-9e79-0d61a393b6a0', '0d0c561e-057c-42f9-a9d7-967bc6d34399'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:56 devstack sudo[84685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:52:56 devstack sudo[84685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:56 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f" returned: 0 in 0.720s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:56 devstack sudo[84690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 Apr 27 23:52:56 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:57 devstack sudo[84685]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.792s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:57 devstack cinder-volume[81312]: DEBUG cinder.manager [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:52:57 devstack cinder-volume[81312]: INFO cinder.volume.manager [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Deleted volume successfully. Apr 27 23:52:57 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=154,cinder:INSERT=52,cinder:UPDATE=193,cinder:DELETE=15 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:52:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [req-1511d8e3-6ba4-45af-8a0e-c18650ffcc48 req-9316eef7-c0b8-48c2-a4d7-78beadccfb92 tempest-ServerBootFromVolumeStableRescueTest-1048432770 None] Lock "cinder-d602e579-efd7-446c-9325-18e0e96913a4-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:57 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691" returned: 0 in 0.768s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:57 devstack sudo[84696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691 Apr 27 23:52:57 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:58 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root Apr 27 23:52:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f.86ff1ebb-f4d1-4d35-ba27-59d63b361691" returned: 0 in 0.616s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:52:58 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=138,cinder:INSERT=47,cinder:UPDATE=218,cinder:DELETE=16 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:52:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-86ff1ebb-f4d1-4d35-ba27-59d63b361691" released by "_delete_snapshot" :: held 3.130s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-b32cdc62-7609-45f3-9f05-55075deae34f" released by "delete_snapshot" :: held 3.159s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:58 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Created reservations ['a7ef2727-82d7-414f-8a9e-404232d05b98', '97618f31-c6bb-41f0-9a28-f04fc1449b4b', 'ffdf0701-63bd-46f6-a664-425499690264', '25f9ddbe-f4f9-48ce-8f4e-7e8b2d790af5'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:52:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Delete snapshot completed successfully. Apr 27 23:52:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-378e9451-153e-4ad5-af06-9bcb8fc728cb tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-86ff1ebb-f4d1-4d35-ba27-59d63b361691-delete_snapshot" released by "delete_snapshot" :: held 3.343s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-b32cdc62-7609-45f3-9f05-55075deae34f-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-b32cdc62-7609-45f3-9f05-55075deae34f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "cinder-quobyte-b32cdc62-7609-45f3-9f05-55075deae34f" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Flow 'volume_create_manager' (dd709e36-f359-407c-a470-d85d81cfc76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2822687-9791-4f98-a198-a5ff0add72b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2822687-9791-4f98-a198-a5ff0add72b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1492283259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6557b024-94ec-4e10-b6f2-af354cd888c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd5184af2ed430c95cb8f223420c5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:59Z,use_quota=True,user_id='456fe93fcf7d418a88c073ff7ecb7529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c242f70-f4b1-4310-9f70-e88f02db66e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c242f70-f4b1-4310-9f70-e88f02db66e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6ce810-147c-4bae-8e07-8c49ec75542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6ce810-147c-4bae-8e07-8c49ec75542e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6557b024-94ec-4e10-b6f2-af354cd888c8', 'volume_name': 'volume-6557b024-94ec-4e10-b6f2-af354cd888c8', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea558db-4a32-436f-bd2b-9ebd4d1cd4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea558db-4a32-436f-bd2b-9ebd4d1cd4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8794e684-519f-4291-b8ba-ab392103e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:52:59 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Volume 6557b024-94ec-4e10-b6f2-af354cd888c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6557b024-94ec-4e10-b6f2-af354cd888c8', 'volume_size': 1} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1492283259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6557b024-94ec-4e10-b6f2-af354cd888c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd5184af2ed430c95cb8f223420c5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:52:59Z,use_quota=True,user_id='456fe93fcf7d418a88c073ff7ecb7529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Creating volume 6557b024-94ec-4e10-b6f2-af354cd888c8 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:52:59 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-b32cdc62-7609-45f3-9f05-55075deae34f" acquired by "delete_volume" :: waited 0.148s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:52:59 devstack sudo[84714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 1073741824 Apr 27 23:52:59 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[333fb57e-307f-42a4-9366-35c79730284f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:52:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:52:59 devstack sudo[84717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f Apr 27 23:52:59 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:00 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f" returned: 0 in 0.794s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:00 devstack sudo[84742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f Apr 27 23:53:00 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:00 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 1073741824" returned: 0 in 0.990s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:00 devstack sudo[84744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 Apr 27 23:53:00 devstack sudo[84744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:01 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b32cdc62-7609-45f3-9f05-55075deae34f" returned: 0 in 0.532s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-quobyte-b32cdc62-7609-45f3-9f05-55075deae34f" released by "delete_volume" :: held 1.429s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:01 devstack sudo[84744]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Created reservations ['d354ceed-092d-4060-9c7f-6d3103f0a726', '7073d4be-a58d-44ec-8af1-ea06991df127', '4eaecf6d-aef3-4e22-99fa-9545defb0d69', 'd97c6305-ae68-4ed0-b4e9-31847606d7b7'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8" returned: 0 in 0.521s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8794e684-519f-4291-b8ba-ab392103e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6557b024-94ec-4e10-b6f2-af354cd888c8', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76661baa-b510-4cbc-9bd5-dc7e1f39b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:01 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Volume volume-6557b024-94ec-4e10-b6f2-af354cd888c8 (6557b024-94ec-4e10-b6f2-af354cd888c8): created successfully Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76661baa-b510-4cbc-9bd5-dc7e1f39b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Flow 'volume_create_manager' (dd709e36-f359-407c-a470-d85d81cfc76c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:01 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2f236019-352c-4dd4-ad20-53bd919dac4c tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Created volume successfully. Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:01 devstack sudo[84749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:53:01 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:01 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.621s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:01 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Deleted volume successfully. Apr 27 23:53:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Creating offline snapshot 41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da of volume 6557b024-94ec-4e10-b6f2-af354cd888c8 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:53:02 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-9c72c999-ccf5-4921-aaba-73b89e08367b tempest-CreateVolumesFromSnapshotTest-202710307 None] Lock "cinder-b32cdc62-7609-45f3-9f05-55075deae34f-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:02 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51279a2-3d8c-4f6e-8f64-fc03e2141181]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:02 devstack sudo[84754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 Apr 27 23:53:02 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:02 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8" returned: 0 in 0.692s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:02 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da 1G Apr 27 23:53:02 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:03 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da 1G" returned: 0 in 0.790s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6557b024-94ec-4e10-b6f2-af354cd888c8 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:03 devstack sudo[84764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6557b024-94ec-4e10-b6f2-af354cd888c8 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da Apr 27 23:53:03 devstack sudo[84764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:04 devstack sudo[84764]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6557b024-94ec-4e10-b6f2-af354cd888c8 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da" returned: 0 in 0.698s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:04 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da is being set with open permissions: ugo+rw Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:04 devstack sudo[84769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da Apr 27 23:53:04 devstack sudo[84769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:04 devstack sudo[84769]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da" returned: 0 in 0.560s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:04 devstack sudo[84772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.info Apr 27 23:53:04 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (e9c46f20-e57e-4251-a602-e7ecd5c02778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a05f4d-2b47-4095-af4a-a497a8c1beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a05f4d-2b47-4095-af4a-a497a8c1beb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74973544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa42701f-ed86-49b9-8809-a1e2375bac2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:05Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af57dd8f-b251-4600-9f75-ad7931714e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af57dd8f-b251-4600-9f75-ad7931714e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909bfb35-6ac2-401a-b5e3-eed87ea1c409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909bfb35-6ac2-401a-b5e3-eed87ea1c409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa42701f-ed86-49b9-8809-a1e2375bac2b', 'volume_name': 'volume-aa42701f-ed86-49b9-8809-a1e2375bac2b', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47978fc2-1da7-494f-964d-d96b7ba31bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47978fc2-1da7-494f-964d-d96b7ba31bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6245cfaa-9341-4269-9798-bd456df18404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:04 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume aa42701f-ed86-49b9-8809-a1e2375bac2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa42701f-ed86-49b9-8809-a1e2375bac2b', 'volume_size': 1} Apr 27 23:53:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:05 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.info" returned: 0 in 0.540s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:05 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.info is being set with open permissions: ugo+rw Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:05 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.info Apr 27 23:53:05 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:05 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.info" returned: 0 in 0.509s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.954s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74973544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa42701f-ed86-49b9-8809-a1e2375bac2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:05Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Creating volume aa42701f-ed86-49b9-8809-a1e2375bac2b {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:53:05 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:53:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-800c5157-f7e1-493f-91a5-f9e0f4d49dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Create snapshot completed successfully Apr 27 23:53:06 devstack sudo[84778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b 1073741824 Apr 27 23:53:06 devstack sudo[84778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Acquiring lock "cinder-41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Acquiring lock "cinder-quobyte-6557b024-94ec-4e10-b6f2-af354cd888c8" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-quobyte-6557b024-94ec-4e10-b6f2-af354cd888c8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Acquiring lock "cinder-quobyte-41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-quobyte-41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Deleting offline snapshot 41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da of volume 6557b024-94ec-4e10-b6f2-af354cd888c8 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] snapshot_file for this snap is: volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9370f1d-1666-456c-9da7-d3f8b32bf5a3]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:06 devstack sudo[84778]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b 1073741824" returned: 0 in 0.934s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:06 devstack sudo[84784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da Apr 27 23:53:06 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:07 devstack sudo[84786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b Apr 27 23:53:07 devstack sudo[84786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:07 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da" returned: 0 in 0.858s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6557b024-94ec-4e10-b6f2-af354cd888c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70bb269-9b28-46a9-8236-bb7a5db28905]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:07 devstack sudo[84786]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b" returned: 0 in 0.843s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6245cfaa-9341-4269-9798-bd456df18404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa42701f-ed86-49b9-8809-a1e2375bac2b', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8cb4af-828d-4a9d-95f6-0b69c6a8e8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:07 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume volume-aa42701f-ed86-49b9-8809-a1e2375bac2b (aa42701f-ed86-49b9-8809-a1e2375bac2b): created successfully Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8cb4af-828d-4a9d-95f6-0b69c6a8e8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (e9c46f20-e57e-4251-a602-e7ecd5c02778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:07 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ea315fe7-82f8-4a03-9b03-745d7b1343c8 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created volume successfully. Apr 27 23:53:07 devstack sudo[84794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 Apr 27 23:53:07 devstack sudo[84794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (f7b54094-1558-4b3d-a33c-67cbcd50c356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8876551-ed25-4466-be35-8a43565cf0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8876551-ed25-4466-be35-8a43565cf0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1325310630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189efad9-bc33-453f-8551-81fb6b4533e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:09Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba3fd52-3527-43f9-95b5-7a459aa62b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba3fd52-3527-43f9-95b5-7a459aa62b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a2e2f6-8939-40aa-a490-0255544c3118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a2e2f6-8939-40aa-a490-0255544c3118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189efad9-bc33-453f-8551-81fb6b4533e7', 'volume_name': 'volume-189efad9-bc33-453f-8551-81fb6b4533e7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf55b8b-2acc-4ce0-9214-c0ef5fa47ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:08 devstack sudo[84794]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf55b8b-2acc-4ce0-9214-c0ef5fa47ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3fff8b-f901-4e9c-b893-26f001bde47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:08 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume 189efad9-bc33-453f-8551-81fb6b4533e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189efad9-bc33-453f-8551-81fb6b4533e7', 'volume_size': 1} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1325310630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189efad9-bc33-453f-8551-81fb6b4533e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:09Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Creating volume 189efad9-bc33-453f-8551-81fb6b4533e7 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:53:08 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8" returned: 0 in 0.993s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:08 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da Apr 27 23:53:08 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:08 devstack sudo[84800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7 1073741824 Apr 27 23:53:08 devstack sudo[84800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (e699ac86-d219-4166-af7a-45a00f48455e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6db633d-e90e-4701-aa6f-5b4bd83aeeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6db633d-e90e-4701-aa6f-5b4bd83aeeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-882793850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da061b02-6a2e-4b25-b267-18b66bd89f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:09Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926246c3-5cf7-4ded-8071-34f3a0161056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926246c3-5cf7-4ded-8071-34f3a0161056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f5ab63-128e-473c-af79-9ea0322f8cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f5ab63-128e-473c-af79-9ea0322f8cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da061b02-6a2e-4b25-b267-18b66bd89f26', 'volume_name': 'volume-da061b02-6a2e-4b25-b267-18b66bd89f26', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857d1115-1c07-4e38-832b-529f3edd3513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857d1115-1c07-4e38-832b-529f3edd3513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0338077e-605c-434b-9800-4c458bdbde11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume da061b02-6a2e-4b25-b267-18b66bd89f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da061b02-6a2e-4b25-b267-18b66bd89f26', 'volume_size': 1} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (8894e6f5-340c-4468-afc3-39d18158cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc5e5fa-4520-4203-826c-248319ae5813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc5e5fa-4520-4203-826c-248319ae5813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064512646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e5226d-b8d3-4ea9-9522-ab8ffe828ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:10Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2275dd-82b4-4a92-a2c9-8ab1fe1f0481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2275dd-82b4-4a92-a2c9-8ab1fe1f0481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba8e1e3-2081-4fbc-b824-739d1f5dfe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba8e1e3-2081-4fbc-b824-739d1f5dfe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e5226d-b8d3-4ea9-9522-ab8ffe828ea6', 'volume_name': 'volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ff53f1-d830-4df9-af5a-10e9802f782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ff53f1-d830-4df9-af5a-10e9802f782c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b7d18d-8c3f-46ac-8f9b-1e9aef24a41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:09 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume 20e5226d-b8d3-4ea9-9522-ab8ffe828ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6', 'volume_size': 1} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:09 devstack sudo[84800]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7 1073741824" returned: 0 in 1.138s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:09 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da" returned: 0 in 1.198s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:09 devstack sudo[84811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7 Apr 27 23:53:09 devstack sudo[84811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:10 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da Apr 27 23:53:10 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (8d67a77f-8091-4e56-bc90-8143d246cc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c2c122-efef-4a2f-8c0f-0d5bb2189b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c2c122-efef-4a2f-8c0f-0d5bb2189b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-125354125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f38620c-439d-4752-8ac3-45f106908a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:10Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f18bf93-5a3a-4e1d-9a53-7011262a8e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f18bf93-5a3a-4e1d-9a53-7011262a8e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8356ec94-82ba-4c91-ba30-c718203053d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8356ec94-82ba-4c91-ba30-c718203053d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f38620c-439d-4752-8ac3-45f106908a19', 'volume_name': 'volume-6f38620c-439d-4752-8ac3-45f106908a19', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d627633-a98b-4b30-b1d7-93be1c8c2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d627633-a98b-4b30-b1d7-93be1c8c2a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a524a1ed-2560-446a-8516-1c4ce45ee50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume 6f38620c-439d-4752-8ac3-45f106908a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f38620c-439d-4752-8ac3-45f106908a19', 'volume_size': 1} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (d8a6684a-d8a8-4f7a-988e-c9654d38c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43113f14-ad18-4c9d-a369-e7dd81a57326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack sudo[84811]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43113f14-ad18-4c9d-a369-e7dd81a57326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515566619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f332dfd-0b75-43bb-8189-f779fccf3e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:11Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767f3bbd-926e-4d0b-abe2-decec61ba9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767f3bbd-926e-4d0b-abe2-decec61ba9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:10 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3910ba3d-4cce-4865-8fe7-3360f8b25353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3910ba3d-4cce-4865-8fe7-3360f8b25353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f332dfd-0b75-43bb-8189-f779fccf3e6d', 'volume_name': 'volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac3fbba-ad50-4c12-bdd2-98a32a4bb8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac3fbba-ad50-4c12-bdd2-98a32a4bb8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd5fc8b-370b-4ced-8754-237dfadcc3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:10 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume 3f332dfd-0b75-43bb-8189-f779fccf3e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d', 'volume_size': 1} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8.41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da" returned: 0 in 0.944s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7" returned: 0 in 0.982s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-882793850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da061b02-6a2e-4b25-b267-18b66bd89f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:09Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Creating volume da061b02-6a2e-4b25-b267-18b66bd89f26 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:53:10 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3fff8b-f901-4e9c-b893-26f001bde47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189efad9-bc33-453f-8551-81fb6b4533e7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8084f0-98a0-4b91-8f3f-f5905526e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-quobyte-41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da" released by "_delete_snapshot" :: held 4.223s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:11 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume volume-189efad9-bc33-453f-8551-81fb6b4533e7 (189efad9-bc33-453f-8551-81fb6b4533e7): created successfully Apr 27 23:53:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8084f0-98a0-4b91-8f3f-f5905526e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:11 devstack sudo[84817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26 1073741824 Apr 27 23:53:11 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (f7b54094-1558-4b3d-a33c-67cbcd50c356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-quobyte-6557b024-94ec-4e10-b6f2-af354cd888c8" released by "delete_snapshot" :: held 4.290s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cdcce28e-402c-4f4a-9f0e-38f434c40e9b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created volume successfully. Apr 27 23:53:11 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Created reservations ['cc9c9c1b-4a99-4005-ac9d-3fd3ceb1d732', 'fc766113-9012-483b-8519-00128c4c75a8', '1a4054b4-26bf-4497-93a5-d195ca0cc8d5', 'e6b1f7c9-38eb-47e9-bcd2-fb91f75c6442'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:53:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Delete snapshot completed successfully. Apr 27 23:53:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0f160c1a-efba-49b7-9895-d8439fcf5478 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-41f7c48a-e0fd-4b51-bb7d-1f1d3a5b40da-delete_snapshot" released by "delete_snapshot" :: held 4.464s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:11 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26 1073741824" returned: 0 in 0.784s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:11 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26 Apr 27 23:53:11 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Acquiring lock "cinder-6557b024-94ec-4e10-b6f2-af354cd888c8-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-6557b024-94ec-4e10-b6f2-af354cd888c8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Acquiring lock "cinder-quobyte-6557b024-94ec-4e10-b6f2-af354cd888c8" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-quobyte-6557b024-94ec-4e10-b6f2-af354cd888c8" acquired by "delete_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2a46d0-5789-40ab-9719-3d2e7f4644f8]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:12 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26" returned: 0 in 0.649s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.574s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064512646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e5226d-b8d3-4ea9-9522-ab8ffe828ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:10Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Creating volume 20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:53:12 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:12 devstack sudo[84826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 Apr 27 23:53:12 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0338077e-605c-434b-9800-4c458bdbde11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da061b02-6a2e-4b25-b267-18b66bd89f26', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba169458-65ea-4c7a-8712-ba0c20aa32e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:12 devstack sudo[84827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 1073741824 Apr 27 23:53:12 devstack sudo[84827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:12 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume volume-da061b02-6a2e-4b25-b267-18b66bd89f26 (da061b02-6a2e-4b25-b267-18b66bd89f26): created successfully Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba169458-65ea-4c7a-8712-ba0c20aa32e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (e699ac86-d219-4166-af7a-45a00f48455e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:12 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-aac8cdf1-f04e-43d4-b89a-7abdf8ea85e6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created volume successfully. Apr 27 23:53:13 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8" returned: 0 in 0.802s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:13 devstack sudo[84836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8 Apr 27 23:53:13 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:13 devstack sudo[84827]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 1073741824" returned: 0 in 0.827s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:13 devstack sudo[84838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 Apr 27 23:53:13 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:13 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6557b024-94ec-4e10-b6f2-af354cd888c8" returned: 0 in 0.702s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-quobyte-6557b024-94ec-4e10-b6f2-af354cd888c8" released by "delete_volume" :: held 1.574s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:13 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Created reservations ['980c71dd-c8fa-4f84-b4ed-dbd792059c60', '873ed285-9c30-4572-9933-1451d3b148bd', '9b20894a-d812-46ce-9206-267d469fc043', 'f6fcd49f-1337-4716-a96c-3b981a86ef85'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:14 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6" returned: 0 in 0.759s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:14 devstack sudo[84842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:53:14 devstack sudo[84842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.685s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-125354125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f38620c-439d-4752-8ac3-45f106908a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:10Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Creating volume 6f38620c-439d-4752-8ac3-45f106908a19 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:53:14 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b7d18d-8c3f-46ac-8f9b-1e9aef24a41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc481e9-2217-4da5-826d-20bf036ab7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:14 devstack sudo[84844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19 1073741824 Apr 27 23:53:14 devstack sudo[84844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:14 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 (20e5226d-b8d3-4ea9-9522-ab8ffe828ea6): created successfully Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc481e9-2217-4da5-826d-20bf036ab7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (8894e6f5-340c-4468-afc3-39d18158cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:14 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-37396ac8-3ca2-420e-b82a-a74555d45e3b tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created volume successfully. Apr 27 23:53:14 devstack sudo[84842]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.660s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:53:14 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Deleted volume successfully. Apr 27 23:53:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c126eef9-d9f9-43aa-8342-5378e424c814 tempest-VolumeSnapshotQuotasNegativeTestJSON-126218163 None] Lock "cinder-6557b024-94ec-4e10-b6f2-af354cd888c8-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:15 devstack sudo[84844]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19 1073741824" returned: 0 in 1.147s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:15 devstack sudo[84856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19 Apr 27 23:53:15 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:15 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19" returned: 0 in 0.527s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.932s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515566619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f332dfd-0b75-43bb-8189-f779fccf3e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8b6a4496304047847338381025d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:11Z,use_quota=True,user_id='070129b6848c4e839d64d07f53bd48d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Creating volume 3f332dfd-0b75-43bb-8189-f779fccf3e6d {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:53:15 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a524a1ed-2560-446a-8516-1c4ce45ee50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f38620c-439d-4752-8ac3-45f106908a19', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:15 devstack sudo[84860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d 1073741824 Apr 27 23:53:15 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacd5636-5765-4fb2-ac23-a317014199d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:15 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume volume-6f38620c-439d-4752-8ac3-45f106908a19 (6f38620c-439d-4752-8ac3-45f106908a19): created successfully Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacd5636-5765-4fb2-ac23-a317014199d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (8d67a77f-8091-4e56-bc90-8143d246cc47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-a91f53b0-7596-4294-b35a-70283b8366f4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created volume successfully. Apr 27 23:53:16 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d 1073741824" returned: 0 in 0.788s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:16 devstack sudo[84865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d Apr 27 23:53:16 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:17 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d" returned: 0 in 0.558s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd5fc8b-370b-4ced-8754-237dfadcc3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e939f32-43f9-4584-8faa-883d66c5cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:17 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Volume volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d (3f332dfd-0b75-43bb-8189-f779fccf3e6d): created successfully Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e939f32-43f9-4584-8faa-883d66c5cddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Flow 'volume_create_manager' (d8a6684a-d8a8-4f7a-988e-c9654d38c079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:17 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-bcbf41c8-c0eb-4f9c-8933-ea886924aa5f tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created volume successfully. Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-3f332dfd-0b75-43bb-8189-f779fccf3e6d-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-3f332dfd-0b75-43bb-8189-f779fccf3e6d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-quobyte-3f332dfd-0b75-43bb-8189-f779fccf3e6d" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-3f332dfd-0b75-43bb-8189-f779fccf3e6d" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a807873-f17d-4a69-ad07-248814b8c1ad]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:17 devstack sudo[84868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d Apr 27 23:53:17 devstack sudo[84868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:18 devstack sudo[84868]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d" returned: 0 in 0.638s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:18 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d Apr 27 23:53:18 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:18 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f332dfd-0b75-43bb-8189-f779fccf3e6d" returned: 0 in 0.564s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:18 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-3f332dfd-0b75-43bb-8189-f779fccf3e6d" released by "delete_volume" :: held 1.249s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created reservations ['47e2d0bc-9d44-42ac-99c7-6457478c7adc', 'aeb56d52-c954-4ab2-974a-2efe74126595', '98e767bb-d6f9-4db5-ac49-d750f9e6b80f', 'b0c9e3d4-9c75-48c4-bd57-def3913dcef2'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:19 devstack sudo[84877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:53:19 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:19 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.562s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:53:19 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Deleted volume successfully. Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4f78a8ef-731b-4a7d-a386-1ca13a910e64 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-3f332dfd-0b75-43bb-8189-f779fccf3e6d-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-6f38620c-439d-4752-8ac3-45f106908a19-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-6f38620c-439d-4752-8ac3-45f106908a19-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-quobyte-6f38620c-439d-4752-8ac3-45f106908a19" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-6f38620c-439d-4752-8ac3-45f106908a19" acquired by "delete_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5683f2-140b-45a6-a3f7-32ea6bb8fb7c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:20 devstack sudo[84880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19 Apr 27 23:53:20 devstack sudo[84880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:20 devstack sudo[84880]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19" returned: 0 in 0.576s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:20 devstack sudo[84887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19 Apr 27 23:53:20 devstack sudo[84887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:21 devstack sudo[84887]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6f38620c-439d-4752-8ac3-45f106908a19" returned: 0 in 0.603s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-6f38620c-439d-4752-8ac3-45f106908a19" released by "delete_volume" :: held 1.233s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created reservations ['31106c92-e43c-499b-9818-9f227e54821e', '19143186-ab81-4d0b-9390-66b53abb7bdd', 'ea6e59fb-491a-4fd5-8368-569dfe16add9', '2b476e33-6932-42d9-be1d-a7c65898d2e6'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:21 devstack sudo[84890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:53:21 devstack sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:21 devstack sudo[84890]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.565s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:53:21 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Deleted volume successfully. Apr 27 23:53:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2fe5a4e4-3e08-41c0-b2ab-24a833f74afb tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-6f38620c-439d-4752-8ac3-45f106908a19-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-quobyte-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:22 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52f9a39-1e04-4f0e-b19a-8aa32b536e0c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:22 devstack sudo[84893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 Apr 27 23:53:22 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:22 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6" returned: 0 in 0.720s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:23 devstack sudo[84898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6 Apr 27 23:53:23 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:23 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6" returned: 0 in 0.626s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6" released by "delete_volume" :: held 1.415s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:23 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created reservations ['f39710be-dcb8-46fa-b890-52a96d5e2814', 'f8bab069-64bc-4306-b283-b3a35b75b5ed', '82362782-5b2c-4587-a358-be25dc76e510', 'fc59ac79-5a72-49cb-afcf-b46fc31b6929'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:53:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:23 devstack sudo[84901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:53:23 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-da061b02-6a2e-4b25-b267-18b66bd89f26-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-da061b02-6a2e-4b25-b267-18b66bd89f26-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:24 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.796s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:24 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:53:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-quobyte-da061b02-6a2e-4b25-b267-18b66bd89f26" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:24 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Deleted volume successfully. Apr 27 23:53:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-da061b02-6a2e-4b25-b267-18b66bd89f26" acquired by "delete_volume" :: waited 0.033s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-35b36a90-42dd-45c8-8a30-e9272103f7f6 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-20e5226d-b8d3-4ea9-9522-ab8ffe828ea6-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:24 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[90626554-8f18-4a4d-8ab2-616d81d8c1f0]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:24 devstack sudo[84905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26 Apr 27 23:53:24 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:25 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26" returned: 0 in 0.682s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:25 devstack sudo[84910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26 Apr 27 23:53:25 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:26 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-da061b02-6a2e-4b25-b267-18b66bd89f26" returned: 0 in 0.727s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-da061b02-6a2e-4b25-b267-18b66bd89f26" released by "delete_volume" :: held 1.454s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created reservations ['3ec79d2c-fcda-4aa5-ad11-bffabbcb4e3f', '66acf549-4bbd-47be-8f70-f16ceb8e3173', '78dfdb70-b8cc-473f-82b3-548a453ab89a', '6238ac02-07a6-4b19-8f01-69b22bcef6a3'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:26 devstack sudo[84918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:53:26 devstack sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:26 devstack sudo[84918]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.690s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:26 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:53:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Deleted volume successfully. Apr 27 23:53:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6840031e-e605-404f-aad9-2e3fb93a4cd4 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-da061b02-6a2e-4b25-b267-18b66bd89f26-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-189efad9-bc33-453f-8551-81fb6b4533e7-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-189efad9-bc33-453f-8551-81fb6b4533e7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-quobyte-189efad9-bc33-453f-8551-81fb6b4533e7" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-189efad9-bc33-453f-8551-81fb6b4533e7" acquired by "delete_volume" :: waited 0.043s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:27 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[01674627-c5bc-44fc-a8aa-96195bed5e8c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:27 devstack sudo[84927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7 Apr 27 23:53:27 devstack sudo[84927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:27 devstack sudo[84927]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7" returned: 0 in 0.660s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:27 devstack sudo[84932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7 Apr 27 23:53:27 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:28 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-189efad9-bc33-453f-8551-81fb6b4533e7" returned: 0 in 0.685s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:28 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-189efad9-bc33-453f-8551-81fb6b4533e7" released by "delete_volume" :: held 1.398s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:28 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created reservations ['588f610d-38d5-4a28-90b8-79c30e113f4a', '6f1fa327-fd42-4b0d-b421-8fac86dcf7cd', '8a1110ee-a7c7-44d7-a322-13ec65e6c7de', '781cd931-97a0-4361-b595-508174b9f937'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:53:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:28 devstack sudo[84938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:53:28 devstack sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:29 devstack sudo[84938]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.621s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:29 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:53:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-aa42701f-ed86-49b9-8809-a1e2375bac2b-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:29 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Deleted volume successfully. Apr 27 23:53:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1aebad08-373e-4883-839e-f741c2862225 tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-189efad9-bc33-453f-8551-81fb6b4533e7-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-aa42701f-ed86-49b9-8809-a1e2375bac2b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "cinder-quobyte-aa42701f-ed86-49b9-8809-a1e2375bac2b" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-aa42701f-ed86-49b9-8809-a1e2375bac2b" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:29 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6967fef9-7b40-4d9f-9b7b-51428fa61af3]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:29 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b Apr 27 23:53:29 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:30 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b" returned: 0 in 0.649s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:30 devstack sudo[84946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b Apr 27 23:53:30 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:30 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aa42701f-ed86-49b9-8809-a1e2375bac2b" returned: 0 in 0.693s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-quobyte-aa42701f-ed86-49b9-8809-a1e2375bac2b" released by "delete_volume" :: held 1.395s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Created reservations ['1702e66f-b47b-46f6-9182-fcc76e2822ad', 'af0313c9-5f78-4b9d-8472-0f8eee7dcdf2', '4d330e3d-b4a8-4fbb-8d8f-198c9b4e4437', 'a27d0ec0-939e-43c5-b3ed-0a108ec3de2a'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:31 devstack sudo[84949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:53:31 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:31 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.564s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:53:31 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Deleted volume successfully. Apr 27 23:53:31 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3ca56efb-39c1-49be-84cb-97192d7c069d tempest-CreateVolumesFromSourceVolumeTest-347821192 None] Lock "cinder-aa42701f-ed86-49b9-8809-a1e2375bac2b-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:53:41 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=66,cinder:INSERT=22,cinder:UPDATE=92,cinder:DELETE=9 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:53:41 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=71,cinder:INSERT=26,cinder:UPDATE=104,cinder:DELETE=7 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:53:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:53:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:45 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:53:45 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:45 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.856s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Flow 'volume_create_manager' (4d45aedc-0d87-454e-918b-87fa54660561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f786461b-f1ea-4fbc-823c-34661c066171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f786461b-f1ea-4fbc-823c-34661c066171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-667901993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84206f4f-64e8-4abd-99a8-425f0c32af58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbed932240d41fc8f7acacda3873d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:52Z,use_quota=True,user_id='b3e62a9b1acb491d99a1bdfe5afb9a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f220eaf1-f38e-47da-8b17-08211d9b520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f220eaf1-f38e-47da-8b17-08211d9b520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0522b0a3-fd37-48ce-ad3d-38b4bcd49e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0522b0a3-fd37-48ce-ad3d-38b4bcd49e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84206f4f-64e8-4abd-99a8-425f0c32af58', 'volume_name': 'volume-84206f4f-64e8-4abd-99a8-425f0c32af58', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cc5a9d-5680-48db-ae62-a0a42b93cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cc5a9d-5680-48db-ae62-a0a42b93cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e3ed8b-8d3b-4025-8bfe-f67ee0a310e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:52 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Volume 84206f4f-64e8-4abd-99a8-425f0c32af58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84206f4f-64e8-4abd-99a8-425f0c32af58', 'volume_size': 1} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-667901993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84206f4f-64e8-4abd-99a8-425f0c32af58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbed932240d41fc8f7acacda3873d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:53:52Z,use_quota=True,user_id='b3e62a9b1acb491d99a1bdfe5afb9a9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Creating volume 84206f4f-64e8-4abd-99a8-425f0c32af58 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:53:52 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:53:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:53 devstack sudo[85175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58 1073741824 Apr 27 23:53:53 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:55 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58 1073741824" returned: 0 in 2.642s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:55 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58 Apr 27 23:53:55 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:56 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58" returned: 0 in 0.870s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] <== create_volume: return (3659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:53:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.666s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:53:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e3ed8b-8d3b-4025-8bfe-f67ee0a310e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84206f4f-64e8-4abd-99a8-425f0c32af58', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9e6a07-9506-42fb-86ff-e1e4bcd2891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:53:56 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Volume volume-84206f4f-64e8-4abd-99a8-425f0c32af58 (84206f4f-64e8-4abd-99a8-425f0c32af58): created successfully Apr 27 23:53:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9e6a07-9506-42fb-86ff-e1e4bcd2891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:53:56 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Flow 'volume_create_manager' (4d45aedc-0d87-454e-918b-87fa54660561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:53:56 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-9d90e030-b932-4b13-926d-08b4b7605d8a tempest-AbsoluteLimitsTests-1227240284 None] Created volume successfully. Apr 27 23:53:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Acquiring lock "cinder-84206f4f-64e8-4abd-99a8-425f0c32af58-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Lock "cinder-84206f4f-64e8-4abd-99a8-425f0c32af58-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Acquiring lock "cinder-quobyte-84206f4f-64e8-4abd-99a8-425f0c32af58" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:53:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Lock "cinder-quobyte-84206f4f-64e8-4abd-99a8-425f0c32af58" acquired by "delete_volume" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:53:57 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[273ee4eb-34a6-4a66-8744-577686dd8a66]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:53:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:57 devstack sudo[85239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58 Apr 27 23:53:57 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:53:58 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root Apr 27 23:53:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58" returned: 0 in 1.236s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:53:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:53:58 devstack sudo[85249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58 Apr 27 23:53:58 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:00 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-84206f4f-64e8-4abd-99a8-425f0c32af58" returned: 0 in 1.355s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:00 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Lock "cinder-quobyte-84206f4f-64e8-4abd-99a8-425f0c32af58" released by "delete_volume" :: held 2.718s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:00 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Created reservations ['31c5d220-1306-4503-8d16-0a6a6b4c53b4', 'fcef6301-9d76-4e6a-8156-7c9e5fd2ac5e', '27900038-ec48-4d4c-ac7b-64fe787a6092', 'c1e9f0c0-50c0-4b57-9eff-a9194c43ca9e'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:00 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:00 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:01 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.313s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:01 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:01 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Deleted volume successfully. Apr 27 23:54:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-69ae5d6c-cf34-4385-8f10-5b4e67dec684 tempest-AbsoluteLimitsTests-1227240284 None] Lock "cinder-84206f4f-64e8-4abd-99a8-425f0c32af58-delete_volume" released by "delete_volume" :: held 4.523s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (5a5e428e-10c1-44e3-8889-ef11e662a462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6676a974-6eb2-4636-a97a-af41e527396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6676a974-6eb2-4636-a97a-af41e527396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116516349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a55f41-c0a2-4788-b078-36a616a1bd02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:03Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d315938f-141e-47ef-8f95-bcd632bfb6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d315938f-141e-47ef-8f95-bcd632bfb6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112e61c5-9133-4bf9-88e8-4770f389d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112e61c5-9133-4bf9-88e8-4770f389d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a55f41-c0a2-4788-b078-36a616a1bd02', 'volume_name': 'volume-b7a55f41-c0a2-4788-b078-36a616a1bd02', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9876b923-8681-4a2f-ba12-8e3c93974eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9876b923-8681-4a2f-ba12-8e3c93974eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116010f0-066e-4ff0-ac8a-12237a37781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:02 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Volume b7a55f41-c0a2-4788-b078-36a616a1bd02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a55f41-c0a2-4788-b078-36a616a1bd02', 'volume_size': 1} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116516349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a55f41-c0a2-4788-b078-36a616a1bd02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:03Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Creating volume b7a55f41-c0a2-4788-b078-36a616a1bd02 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:03 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:03 devstack sudo[85311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 1073741824 Apr 27 23:54:03 devstack sudo[85311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:04 devstack sudo[85311]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 1073741824" returned: 0 in 1.681s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:04 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 Apr 27 23:54:04 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:06 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02" returned: 0 in 1.827s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] <== create_volume: return (3608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:54:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.611s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116010f0-066e-4ff0-ac8a-12237a37781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a55f41-c0a2-4788-b078-36a616a1bd02', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722dc699-d529-4fdb-93ed-5b4106f67cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:06 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Volume volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 (b7a55f41-c0a2-4788-b078-36a616a1bd02): created successfully Apr 27 23:54:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722dc699-d529-4fdb-93ed-5b4106f67cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (5a5e428e-10c1-44e3-8889-ef11e662a462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7167b0c0-5b01-416b-9693-2bd4b13038fe tempest-VolumesActionsTest-1878978502 None] Created volume successfully. Apr 27 23:54:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-71b5b5af-245e-463d-b5c0-35e4a5ef879a tempest-VolumesActionsTest-1878978502 None] Acquiring lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02" by "attach_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-71b5b5af-245e-463d-b5c0-35e4a5ef879a tempest-VolumesActionsTest-1878978502 None] Lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02" acquired by "attach_volume" :: waited 0.050s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:08 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-71b5b5af-245e-463d-b5c0-35e4a5ef879a tempest-VolumesActionsTest-1878978502 None] Attaching volume b7a55f41-c0a2-4788-b078-36a616a1bd02 to instance 6b2576d8-2978-45ac-95e6-5201784995b6 at mountpoint /dev/vdb on host None. Apr 27 23:54:08 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-71b5b5af-245e-463d-b5c0-35e4a5ef879a tempest-VolumesActionsTest-1878978502 None] Attach volume completed successfully. Apr 27 23:54:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-71b5b5af-245e-463d-b5c0-35e4a5ef879a tempest-VolumesActionsTest-1878978502 None] Lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02" released by "attach_volume" :: held 0.801s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:10 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-4444b7f2-d51e-4a5d-ab5d-f7f265bd59c2 tempest-VolumesActionsTest-478292297 None] Terminate volume connection completed successfully. Apr 27 23:54:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4444b7f2-d51e-4a5d-ab5d-f7f265bd59c2 tempest-VolumesActionsTest-478292297 None] Acquiring lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02-detach_volume" by "detach_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4444b7f2-d51e-4a5d-ab5d-f7f265bd59c2 tempest-VolumesActionsTest-478292297 None] Lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:10 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-4444b7f2-d51e-4a5d-ab5d-f7f265bd59c2 tempest-VolumesActionsTest-478292297 None] Detaching volume b7a55f41-c0a2-4788-b078-36a616a1bd02 from instance 6b2576d8-2978-45ac-95e6-5201784995b6. Apr 27 23:54:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-4444b7f2-d51e-4a5d-ab5d-f7f265bd59c2 tempest-VolumesActionsTest-478292297 None] Detach volume completed successfully. Apr 27 23:54:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4444b7f2-d51e-4a5d-ab5d-f7f265bd59c2 tempest-VolumesActionsTest-478292297 None] Lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02-detach_volume" released by "detach_volume" :: held 0.215s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-693a8d37-52c5-4fca-ac75-e1002bbd0387 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02-detach_volume" by "detach_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-693a8d37-52c5-4fca-ac75-e1002bbd0387 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:12 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-693a8d37-52c5-4fca-ac75-e1002bbd0387 tempest-VolumesActionsTest-1878978502 None] Volume detach called, but volume not attached. Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-693a8d37-52c5-4fca-ac75-e1002bbd0387 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Flow 'volume_create_manager' (3508ac98-93ce-4737-ab50-9c44b1bcaa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbbf975-a612-414b-9d2c-dd054889b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbbf975-a612-414b-9d2c-dd054889b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-770816002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9330e123-6371-4dac-a4cb-6d6ef123a15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d505fc843345a8b13328ec8dad777d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:12Z,use_quota=True,user_id='4cc880c8e1f448e3a16dc77b866f31c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0997b4-00c8-4764-b6c8-663b0ade8e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0997b4-00c8-4764-b6c8-663b0ade8e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f071f574-a260-4ae5-b3f6-50862beafc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f071f574-a260-4ae5-b3f6-50862beafc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9330e123-6371-4dac-a4cb-6d6ef123a15d', 'volume_name': 'volume-9330e123-6371-4dac-a4cb-6d6ef123a15d', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490d93a4-f693-4c21-9a60-20f879ff6579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490d93a4-f693-4c21-9a60-20f879ff6579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36019c61-5794-4455-97ff-77c1dff9aa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:12 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Volume 9330e123-6371-4dac-a4cb-6d6ef123a15d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9330e123-6371-4dac-a4cb-6d6ef123a15d', 'volume_size': 1} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-770816002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9330e123-6371-4dac-a4cb-6d6ef123a15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d505fc843345a8b13328ec8dad777d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:12Z,use_quota=True,user_id='4cc880c8e1f448e3a16dc77b866f31c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Creating volume 9330e123-6371-4dac-a4cb-6d6ef123a15d {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:12 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:12 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d 1073741824 Apr 27 23:54:12 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "cinder-quobyte-b7a55f41-c0a2-4788-b078-36a616a1bd02" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-quobyte-b7a55f41-c0a2-4788-b078-36a616a1bd02" acquired by "delete_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:13 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[08489e44-7b23-4c8d-8328-731c6c3c5041]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:13 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 Apr 27 23:54:13 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Flow 'volume_create_manager' (5d136da4-6d9a-40d7-bd8a-daa4b4856487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30cbca4-1e73-4c2e-b693-630099a2aca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:14 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30cbca4-1e73-4c2e-b693-630099a2aca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1726435582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48ff450-f646-4732-babd-64c8bea83480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ccf2fd58d4e3da0d00a3116bf2c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:14Z,use_quota=True,user_id='a1f83a7811eb4671af489544f56b1d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87afe57e-93fb-4e5d-aeeb-2ea72dfc6ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87afe57e-93fb-4e5d-aeeb-2ea72dfc6ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab6be2f-e16f-440e-b3d2-f575a88dea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab6be2f-e16f-440e-b3d2-f575a88dea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48ff450-f646-4732-babd-64c8bea83480', 'volume_name': 'volume-b48ff450-f646-4732-babd-64c8bea83480', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448840af-06f0-4157-9388-c4bdbe1ebf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448840af-06f0-4157-9388-c4bdbe1ebf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7df4db-7348-46e7-a332-3be57a8e4b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:14 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Volume b48ff450-f646-4732-babd-64c8bea83480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48ff450-f646-4732-babd-64c8bea83480', 'volume_size': 1} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d 1073741824" returned: 0 in 1.497s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:14 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d Apr 27 23:54:14 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:14 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02" returned: 0 in 1.213s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:14 devstack sudo[85466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02 Apr 27 23:54:14 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:14 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d" returned: 0 in 0.593s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1726435582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48ff450-f646-4732-babd-64c8bea83480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ccf2fd58d4e3da0d00a3116bf2c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:14Z,use_quota=True,user_id='a1f83a7811eb4671af489544f56b1d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Creating volume b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:14 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36019c61-5794-4455-97ff-77c1dff9aa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9330e123-6371-4dac-a4cb-6d6ef123a15d', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878a6752-8288-4308-b674-959abcf96737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:15 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Volume volume-9330e123-6371-4dac-a4cb-6d6ef123a15d (9330e123-6371-4dac-a4cb-6d6ef123a15d): created successfully Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878a6752-8288-4308-b674-959abcf96737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:15 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 1073741824 Apr 27 23:54:15 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Flow 'volume_create_manager' (3508ac98-93ce-4737-ab50-9c44b1bcaa6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-20319bf5-26ac-469e-9003-030925aaada2 tempest-ServerRescueNegativeTestJSON-754213730 None] Created volume successfully. Apr 27 23:54:15 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7a55f41-c0a2-4788-b078-36a616a1bd02" returned: 0 in 0.691s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-quobyte-b7a55f41-c0a2-4788-b078-36a616a1bd02" released by "delete_volume" :: held 1.986s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Flow 'volume_create_manager' (ee62a9d7-e0d4-441e-ac19-9a8c008dfc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb50c87-0183-42f0-b120-70f589594c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb50c87-0183-42f0-b120-70f589594c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1864323851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f754a8-e990-41aa-b070-3f75c503b9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a2318a38a74418a3ae12761b68a472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:15Z,use_quota=True,user_id='f67a9368e4ad41fa87db24289126e04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01502bb0-0462-4b4e-b6a7-8c7dc1a4dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01502bb0-0462-4b4e-b6a7-8c7dc1a4dac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98918bba-fbc2-4745-a616-4a031ef4b203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98918bba-fbc2-4745-a616-4a031ef4b203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f754a8-e990-41aa-b070-3f75c503b9ca', 'volume_name': 'volume-24f754a8-e990-41aa-b070-3f75c503b9ca', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192ebb94-e2e4-4c82-996e-6bca22ef7460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192ebb94-e2e4-4c82-996e-6bca22ef7460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588bb213-243f-45d9-9afb-c1b285889d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:15 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Volume 24f754a8-e990-41aa-b070-3f75c503b9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f754a8-e990-41aa-b070-3f75c503b9ca', 'volume_size': 1} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Created reservations ['74442bcb-0b4b-4044-b8bc-13436e4170f2', 'f9c169d8-4164-4db9-a4fa-5565d6dda3a0', 'e1045dc4-d2ca-41fb-89e9-f3b45b176baa', '556808c8-7140-40c2-b3ec-2ea82821bdfe'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:15 devstack sudo[85478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:15 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:15 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 1073741824" returned: 0 in 0.778s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:15 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 Apr 27 23:54:15 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:15 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.498s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Deleted volume successfully. Apr 27 23:54:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ba4fa09-a608-4471-8716-9d6e92b99921 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-b7a55f41-c0a2-4788-b078-36a616a1bd02-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:16 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480" returned: 0 in 0.558s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1864323851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f754a8-e990-41aa-b070-3f75c503b9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a2318a38a74418a3ae12761b68a472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:15Z,use_quota=True,user_id='f67a9368e4ad41fa87db24289126e04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Creating volume 24f754a8-e990-41aa-b070-3f75c503b9ca {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:16 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7df4db-7348-46e7-a332-3be57a8e4b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48ff450-f646-4732-babd-64c8bea83480', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a5f079-5d76-4bc7-8783-e8987fd63d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:16 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Volume volume-b48ff450-f646-4732-babd-64c8bea83480 (b48ff450-f646-4732-babd-64c8bea83480): created successfully Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a5f079-5d76-4bc7-8783-e8987fd63d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:16 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Flow 'volume_create_manager' (5d136da4-6d9a-40d7-bd8a-daa4b4856487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:16 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-57ff37bc-f8da-4731-9264-83fe952e19ee tempest-SnapshotDependencyTests-1189542126 None] Created volume successfully. Apr 27 23:54:16 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca 1073741824 Apr 27 23:54:16 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:17 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca 1073741824" returned: 0 in 0.815s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:17 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca Apr 27 23:54:17 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:17 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca" returned: 0 in 0.770s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:54:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588bb213-243f-45d9-9afb-c1b285889d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f754a8-e990-41aa-b070-3f75c503b9ca', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0129ab79-4b73-4a17-a139-5a84bd7d649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:18 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Creating offline snapshot 271205b9-31f7-4a3c-8013-c2e71a2188f3 of volume b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:54:18 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Volume volume-24f754a8-e990-41aa-b070-3f75c503b9ca (24f754a8-e990-41aa-b070-3f75c503b9ca): created successfully Apr 27 23:54:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0129ab79-4b73-4a17-a139-5a84bd7d649c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Flow 'volume_create_manager' (ee62a9d7-e0d4-441e-ac19-9a8c008dfc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:18 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[657eca3d-b1c7-4354-9bc0-39d108194956]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:18 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-953168ad-2a7e-4009-ae21-a96a3721cbd4 tempest-VolumesTransfersV355Test-1557875298 None] Created volume successfully. Apr 27 23:54:18 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 Apr 27 23:54:18 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:19 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480" returned: 0 in 1.217s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:19 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 1G Apr 27 23:54:19 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:19 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-22d5ea4a-e884-4585-b3a7-4cc92846bf66 tempest-VolumesTransfersV355Test-786892156 None] Transfer volume completed successfully. Apr 27 23:54:20 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 1G" returned: 0 in 1.113s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48ff450-f646-4732-babd-64c8bea83480 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:20 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48ff450-f646-4732-babd-64c8bea83480 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 Apr 27 23:54:20 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Acquiring lock "cinder-24f754a8-e990-41aa-b070-3f75c503b9ca-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Lock "cinder-24f754a8-e990-41aa-b070-3f75c503b9ca-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Acquiring lock "cinder-quobyte-24f754a8-e990-41aa-b070-3f75c503b9ca" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Lock "cinder-quobyte-24f754a8-e990-41aa-b070-3f75c503b9ca" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:20 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bc4ef1-db7a-48e4-a93f-dfcf8f953540]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:21 devstack sudo[85597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca Apr 27 23:54:21 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:21 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48ff450-f646-4732-babd-64c8bea83480 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3" returned: 0 in 0.614s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:21 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 is being set with open permissions: ugo+rw Apr 27 23:54:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:21 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 Apr 27 23:54:21 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:21 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca" returned: 0 in 0.562s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:21 devstack sudo[85610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca Apr 27 23:54:21 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:21 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3" returned: 0 in 0.510s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:21 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.info Apr 27 23:54:21 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:22 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-24f754a8-e990-41aa-b070-3f75c503b9ca" returned: 0 in 0.485s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Lock "cinder-quobyte-24f754a8-e990-41aa-b070-3f75c503b9ca" released by "delete_volume" :: held 1.097s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Created reservations ['46f3acea-80d1-4f2d-bdbe-f1c143355b5c', '85a6df73-cb4a-4a1b-9083-0b73db654be9', '960c7a57-9f23-4d27-ab93-a0b544f17e64', '9b3bc0c2-fd25-4642-9acc-90ed32df76a8'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:22 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:22 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:22 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.info" returned: 0 in 0.486s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:22 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.info is being set with open permissions: ugo+rw Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:22 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.info Apr 27 23:54:22 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:22 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.473s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:22 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Deleted volume successfully. Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fd28c5f1-0c3f-4497-ae26-a7811dbc8651 tempest-VolumesTransfersV355Test-873264899 None] Lock "cinder-24f754a8-e990-41aa-b070-3f75c503b9ca-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:22 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.info" returned: 0 in 0.464s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.690s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:22 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0d826469-df9e-4f0f-a834-30e6a0391a12 tempest-SnapshotDependencyTests-1189542126 None] Create snapshot completed successfully Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Flow 'volume_create_manager' (03f313a7-4ed5-48e8-a302-736c90b84502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969c265c-6209-4959-9a54-dc9211038700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969c265c-6209-4959-9a54-dc9211038700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b254ad09-1aec-4a1d-8861-bfd7d8f00611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5ccf2fd58d4e3da0d00a3116bf2c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=271205b9-31f7-4a3c-8013-c2e71a2188f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:23Z,use_quota=True,user_id='a1f83a7811eb4671af489544f56b1d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e70c276-9623-4a2b-b272-a43244b0b1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e70c276-9623-4a2b-b272-a43244b0b1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c711d424-2548-479b-99a0-7d813c597f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c711d424-2548-479b-99a0-7d813c597f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b254ad09-1aec-4a1d-8861-bfd7d8f00611', 'volume_name': 'volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611', 'volume_size': 1, 'snapshot_id': '271205b9-31f7-4a3c-8013-c2e71a2188f3'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad44a10-31a8-4f7d-a38e-716429140d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad44a10-31a8-4f7d-a38e-716429140d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0006b0b-8615-495e-8c5f-4bdd07ef2443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Volume b254ad09-1aec-4a1d-8861-bfd7d8f00611: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611', 'volume_size': 1, 'snapshot_id': '271205b9-31f7-4a3c-8013-c2e71a2188f3'} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "cinder-quobyte-271205b9-31f7-4a3c-8013-c2e71a2188f3-b254ad09-1aec-4a1d-8861-bfd7d8f00611" by "_create_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-271205b9-31f7-4a3c-8013-c2e71a2188f3-b254ad09-1aec-4a1d-8861-bfd7d8f00611" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Creating volume b254ad09-1aec-4a1d-8861-bfd7d8f00611 from snapshot 271205b9-31f7-4a3c-8013-c2e71a2188f3 {{(pid=81312) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "cinder-quobyte-b254ad09-1aec-4a1d-8861-bfd7d8f00611" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Flow 'volume_create_manager' (5c20dd17-21c9-4035-b26f-1c7a26f254c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4bef2b-9157-4ed1-a24e-d08cc77ccef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4bef2b-9157-4ed1-a24e-d08cc77ccef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1166935361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dd799a-4769-40e9-bbd6-7e123735b49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a2318a38a74418a3ae12761b68a472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:23Z,use_quota=True,user_id='f67a9368e4ad41fa87db24289126e04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2adcaec-7c53-47a3-8fd2-a247a0a329aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2adcaec-7c53-47a3-8fd2-a247a0a329aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90222789-92e4-4029-ab69-6b85debb2c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90222789-92e4-4029-ab69-6b85debb2c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23dd799a-4769-40e9-bbd6-7e123735b49e', 'volume_name': 'volume-23dd799a-4769-40e9-bbd6-7e123735b49e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4f309f-bd81-4963-90f2-6c4f97f80364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4f309f-bd81-4963-90f2-6c4f97f80364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8799ea68-4610-4dbc-afc8-db68caee4c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:23 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Volume 23dd799a-4769-40e9-bbd6-7e123735b49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23dd799a-4769-40e9-bbd6-7e123735b49e', 'volume_size': 1} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-b254ad09-1aec-4a1d-8861-bfd7d8f00611" acquired by "_copy_volume_from_snapshot" :: waited 0.085s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] snapshot: 271205b9-31f7-4a3c-8013-c2e71a2188f3, volume: b254ad09-1aec-4a1d-8861-bfd7d8f00611, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[277147b3-f26f-4aa3-8373-bf756de59db0]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:23 devstack sudo[85628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 Apr 27 23:54:23 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:24 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3" returned: 0 in 0.574s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48ff450-f646-4732-babd-64c8bea83480(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:54:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 23:54:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 23:54:24 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1998588-6382-4bb6-aca5-0b4e06943d99]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:24 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 Apr 27 23:54:24 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:24 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480" returned: 0 in 0.547s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:24 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 23:54:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:24 devstack sudo[85641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 Apr 27 23:54:24 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (896a0239-494a-4cfa-bae0-2d6eb45cb3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0221b2e9-795f-46cf-be7c-9a9869642146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0221b2e9-795f-46cf-be7c-9a9869642146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-868391181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7e0df7-32f9-4817-a2aa-16201a83888b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:25Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5aa0458-45a7-41b1-a517-2498087bd8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5aa0458-45a7-41b1-a517-2498087bd8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c742ab-25e3-4dcf-89fc-744d3bd3585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c742ab-25e3-4dcf-89fc-744d3bd3585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7e0df7-32f9-4817-a2aa-16201a83888b', 'volume_name': 'volume-9b7e0df7-32f9-4817-a2aa-16201a83888b', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b1261a-a3e6-4789-8e51-49464a8e9db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b1261a-a3e6-4789-8e51-49464a8e9db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301308a5-4f3e-4f76-b863-1b55aebe4b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:25 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Volume 9b7e0df7-32f9-4817-a2aa-16201a83888b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7e0df7-32f9-4817-a2aa-16201a83888b', 'volume_size': 1} Apr 27 23:54:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:32 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611" returned: 0 in 7.327s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:32 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f33c09-a2d1-4cc4-8599-6225c4c33907]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:32 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 Apr 27 23:54:32 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:32 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480" returned: 0 in 0.825s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:32 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:54:32 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Converted 1024.00 MB image at 139.72 MB/s Apr 27 23:54:32 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 is being set with open permissions: ugo+rw Apr 27 23:54:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:32 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 Apr 27 23:54:32 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:33 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611" returned: 0 in 0.462s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-b254ad09-1aec-4a1d-8861-bfd7d8f00611" released by "_copy_volume_from_snapshot" :: held 9.832s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-271205b9-31f7-4a3c-8013-c2e71a2188f3-b254ad09-1aec-4a1d-8861-bfd7d8f00611" released by "_create_volume_from_snapshot" :: held 9.930s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.949s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.850s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1166935361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dd799a-4769-40e9-bbd6-7e123735b49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a2318a38a74418a3ae12761b68a472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:23Z,use_quota=True,user_id='f67a9368e4ad41fa87db24289126e04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Creating volume 23dd799a-4769-40e9-bbd6-7e123735b49e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:33 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:33 devstack sudo[85763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e 1073741824 Apr 27 23:54:33 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0006b0b-8615-495e-8c5f-4bdd07ef2443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611', 'volume_size': 1, 'snapshot_id': '271205b9-31f7-4a3c-8013-c2e71a2188f3'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410a863f-8741-4beb-868b-de8bb3fa75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:33 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Volume volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 (b254ad09-1aec-4a1d-8861-bfd7d8f00611): created successfully Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410a863f-8741-4beb-868b-de8bb3fa75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Flow 'volume_create_manager' (03f313a7-4ed5-48e8-a302-736c90b84502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:33 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-68a64291-4ad7-47eb-8b3b-52cf365fa704 tempest-SnapshotDependencyTests-1189542126 None] Created volume successfully. Apr 27 23:54:34 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e 1073741824" returned: 0 in 0.655s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:34 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e Apr 27 23:54:34 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "cinder-271205b9-31f7-4a3c-8013-c2e71a2188f3-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-271205b9-31f7-4a3c-8013-c2e71a2188f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "cinder-quobyte-b48ff450-f646-4732-babd-64c8bea83480" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-b48ff450-f646-4732-babd-64c8bea83480" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "cinder-quobyte-271205b9-31f7-4a3c-8013-c2e71a2188f3" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-271205b9-31f7-4a3c-8013-c2e71a2188f3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Deleting offline snapshot 271205b9-31f7-4a3c-8013-c2e71a2188f3 of volume b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] snapshot_file for this snap is: volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6abafa3-5878-44ef-ab53-9802b09ef10d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:34 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 Apr 27 23:54:34 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:34 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e" returned: 0 in 0.655s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.583s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-868391181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7e0df7-32f9-4817-a2aa-16201a83888b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:25Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Creating volume 9b7e0df7-32f9-4817-a2aa-16201a83888b {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:34 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8799ea68-4610-4dbc-afc8-db68caee4c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23dd799a-4769-40e9-bbd6-7e123735b49e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465df4c2-66d2-4553-983e-2383b0b8bde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:34 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b 1073741824 Apr 27 23:54:34 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:34 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Volume volume-23dd799a-4769-40e9-bbd6-7e123735b49e (23dd799a-4769-40e9-bbd6-7e123735b49e): created successfully Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465df4c2-66d2-4553-983e-2383b0b8bde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Flow 'volume_create_manager' (5c20dd17-21c9-4035-b26f-1c7a26f254c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c5757d81-9d8b-46ca-a32a-997dc3c38c28 tempest-VolumesTransfersV355Test-1557875298 None] Created volume successfully. Apr 27 23:54:35 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3" returned: 0 in 0.826s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48ff450-f646-4732-babd-64c8bea83480(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:54:35 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b999487-fc3b-419d-8e58-f5f6b49f19a3]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:35 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 Apr 27 23:54:35 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:35 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b 1073741824" returned: 0 in 1.122s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:36 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b Apr 27 23:54:36 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Acquiring lock "cinder-23dd799a-4769-40e9-bbd6-7e123735b49e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Lock "cinder-23dd799a-4769-40e9-bbd6-7e123735b49e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:36 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Acquiring lock "cinder-quobyte-23dd799a-4769-40e9-bbd6-7e123735b49e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480" returned: 0 in 0.795s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Lock "cinder-quobyte-23dd799a-4769-40e9-bbd6-7e123735b49e" acquired by "delete_volume" :: waited 0.056s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:36 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 Apr 27 23:54:36 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27cd27c-8855-4f0c-953e-d3f049c23d58]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:36 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e Apr 27 23:54:36 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:36 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b" returned: 0 in 0.598s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301308a5-4f3e-4f76-b863-1b55aebe4b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7e0df7-32f9-4817-a2aa-16201a83888b', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b55d382-41fc-4fcc-a3dc-475c2a8469a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:36 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Volume volume-9b7e0df7-32f9-4817-a2aa-16201a83888b (9b7e0df7-32f9-4817-a2aa-16201a83888b): created successfully Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b55d382-41fc-4fcc-a3dc-475c2a8469a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (896a0239-494a-4cfa-bae0-2d6eb45cb3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ddf4ae12-f1ed-4b4c-91be-4af24aea8c3a tempest-VolumesActionsTest-1878978502 None] Created volume successfully. Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Acquiring lock "cinder-9330e123-6371-4dac-a4cb-6d6ef123a15d-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "cinder-9330e123-6371-4dac-a4cb-6d6ef123a15d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:37 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e" returned: 0 in 0.896s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Acquiring lock "cinder-quobyte-9330e123-6371-4dac-a4cb-6d6ef123a15d" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "cinder-quobyte-9330e123-6371-4dac-a4cb-6d6ef123a15d" acquired by "delete_volume" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:37 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e Apr 27 23:54:37 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f3f6d8-33a4-4a8a-b830-ef9582400fcf]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:37 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3" returned: 0 in 1.109s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:37 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d Apr 27 23:54:37 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:37 devstack sudo[85876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3 Apr 27 23:54:37 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Acquiring lock "cinder-9b7e0df7-32f9-4817-a2aa-16201a83888b-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Lock "cinder-9b7e0df7-32f9-4817-a2aa-16201a83888b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Acquiring lock "cinder-quobyte-9b7e0df7-32f9-4817-a2aa-16201a83888b" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Lock "cinder-quobyte-9b7e0df7-32f9-4817-a2aa-16201a83888b" acquired by "delete_volume" :: waited 0.034s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:37 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480.271205b9-31f7-4a3c-8013-c2e71a2188f3" returned: 0 in 0.607s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b2a21-9f82-453c-9978-fe0fff61d1d7]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:38 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-271205b9-31f7-4a3c-8013-c2e71a2188f3" released by "_delete_snapshot" :: held 3.602s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23dd799a-4769-40e9-bbd6-7e123735b49e" returned: 0 in 0.828s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-b48ff450-f646-4732-babd-64c8bea83480" released by "delete_snapshot" :: held 3.637s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Lock "cinder-quobyte-23dd799a-4769-40e9-bbd6-7e123735b49e" released by "delete_volume" :: held 1.818s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:38 devstack sudo[85883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b Apr 27 23:54:38 devstack sudo[85883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Created reservations ['d2268485-d6f1-41de-b9ee-5fa896242bb5', 'a6f0aefa-003b-4056-adf4-538060828b73', 'aa137231-3da0-4118-b2fc-f1cf44035cc2', '18be0302-b44c-4356-b45d-91767c49f0e2'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Created reservations ['75d6fe8e-2e0e-4448-9da7-3a95a1ce6c45', '11e11bec-ec04-47b1-b0a4-d3d787bc1eed', '0dc6c95a-cc4a-4e8a-b12a-2bf1731ae7cc', '5f422a45-68c4-4113-8820-53e40c548576'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:38 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Delete snapshot completed successfully. Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6293c777-0fb5-4ca8-977b-725c1f23287c tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-271205b9-31f7-4a3c-8013-c2e71a2188f3-delete_snapshot" released by "delete_snapshot" :: held 3.879s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:38 devstack sudo[85888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:38 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:38 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d" returned: 0 in 1.136s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:38 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d Apr 27 23:54:38 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "cinder-b48ff450-f646-4732-babd-64c8bea83480-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-b48ff450-f646-4732-babd-64c8bea83480-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "cinder-quobyte-b48ff450-f646-4732-babd-64c8bea83480" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-b48ff450-f646-4732-babd-64c8bea83480" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5966eab-d230-4ebc-8b92-f9fac9c88f3b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:39 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.646s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:39 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Deleted volume successfully. Apr 27 23:54:39 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 Apr 27 23:54:39 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3edd2401-0521-45e2-a093-1ebc40685f73 tempest-VolumesTransfersV355Test-873264899 None] Lock "cinder-23dd799a-4769-40e9-bbd6-7e123735b49e-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:39 devstack sudo[85883]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b" returned: 0 in 1.065s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:39 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b Apr 27 23:54:39 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:39 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9330e123-6371-4dac-a4cb-6d6ef123a15d" returned: 0 in 0.908s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "cinder-quobyte-9330e123-6371-4dac-a4cb-6d6ef123a15d" released by "delete_volume" :: held 2.114s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Created reservations ['4cffc412-7a2e-41ed-95e4-ccd9f34c949b', '1be59787-6f23-4ac7-9ade-9f00155bc116', 'b21584b0-03fb-4409-997b-e0024363af8c', '59ddff55-8b55-4099-9855-25e0d25bba1a'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:39 devstack sudo[85904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:39 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:39 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480" returned: 0 in 0.928s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:39 devstack sudo[85907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480 Apr 27 23:54:39 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:39 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9b7e0df7-32f9-4817-a2aa-16201a83888b" returned: 0 in 0.797s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Lock "cinder-quobyte-9b7e0df7-32f9-4817-a2aa-16201a83888b" released by "delete_volume" :: held 1.978s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Created reservations ['760f9a9b-3a22-435d-8ca8-d96ddbfac8f8', 'fb4faa3e-c15b-45cc-a2eb-0a56206f240f', 'a25c7ca9-8dcc-49a4-90e2-9da0e82ebeb6', 'a20f366f-b391-4ed0-8beb-add66d552534'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:40 devstack sudo[85910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:40 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:40 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.698s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:40 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Deleted volume successfully. Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8a98fa44-dd64-4e0f-91d1-cb86dad907f2 tempest-ServerRescueNegativeTestJSON-754213730 None] Lock "cinder-9330e123-6371-4dac-a4cb-6d6ef123a15d-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:40 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b48ff450-f646-4732-babd-64c8bea83480" returned: 0 in 0.699s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-b48ff450-f646-4732-babd-64c8bea83480" released by "delete_volume" :: held 1.741s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Created reservations ['1e176c2a-7926-4fbb-9cc8-ea031c6c95a3', '6d83b1c0-4290-4410-a466-c49132507ec8', 'baa7a8be-1d00-44dd-b324-5188c33dbef5', 'b16227ba-2ab1-499f-a7b5-920fec70e784'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:41 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:41 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "cinder-b254ad09-1aec-4a1d-8861-bfd7d8f00611-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-b254ad09-1aec-4a1d-8861-bfd7d8f00611-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "cinder-quobyte-b254ad09-1aec-4a1d-8861-bfd7d8f00611" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-b254ad09-1aec-4a1d-8861-bfd7d8f00611" acquired by "delete_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eb6dbe-94a5-47d6-9779-848160cf4af9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (a52f8263-6650-42b6-9760-7fed32321c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151890e6-ad94-4e45-9b3f-6e358ffaabaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:41 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 Apr 27 23:54:41 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151890e6-ad94-4e45-9b3f-6e358ffaabaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-888217703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fcb4e8-50f1-4350-86b8-82806964d552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:41Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:41 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c06d444-d0b5-42c3-9f8f-91c5e481d37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c06d444-d0b5-42c3-9f8f-91c5e481d37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96ed3ec-c86c-48e5-894a-8c67445863c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96ed3ec-c86c-48e5-894a-8c67445863c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68fcb4e8-50f1-4350-86b8-82806964d552', 'volume_name': 'volume-68fcb4e8-50f1-4350-86b8-82806964d552', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca96d4bb-3da6-4a4e-9662-206bb8199197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca96d4bb-3da6-4a4e-9662-206bb8199197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502ed564-81d3-42ef-ae7b-c86ed3115f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:41 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Volume 68fcb4e8-50f1-4350-86b8-82806964d552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68fcb4e8-50f1-4350-86b8-82806964d552', 'volume_size': 1} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-888217703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fcb4e8-50f1-4350-86b8-82806964d552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:41Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Creating volume 68fcb4e8-50f1-4350-86b8-82806964d552 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:41 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.577s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:41 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Deleted volume successfully. Apr 27 23:54:41 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552 1073741824 Apr 27 23:54:41 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d994408f-55c6-472d-a21d-cb351ffd5c8d tempest-VolumesActionsTest-478292297 None] Lock "cinder-9b7e0df7-32f9-4817-a2aa-16201a83888b-delete_volume" released by "delete_volume" :: held 3.945s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:42 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611" returned: 0 in 1.477s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:42 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 2.006s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:42 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:42 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Deleted volume successfully. Apr 27 23:54:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-62ff5cc9-acfc-4d9e-8ca5-905e5eed1db6 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-b48ff450-f646-4732-babd-64c8bea83480-delete_volume" released by "delete_volume" :: held 4.251s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:43 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611 Apr 27 23:54:43 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:43 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552 1073741824" returned: 0 in 1.648s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:43 devstack sudo[85959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552 Apr 27 23:54:43 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:44 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b254ad09-1aec-4a1d-8861-bfd7d8f00611" returned: 0 in 1.167s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-quobyte-b254ad09-1aec-4a1d-8861-bfd7d8f00611" released by "delete_volume" :: held 2.714s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Created reservations ['7dfcaf11-84e2-4dd3-a773-a0d85589f857', 'a2a4de47-6e92-439d-b102-5436fa7fc0ef', '54380c60-f50e-49ca-96fd-68d41ea1494a', 'c6a6660d-e0d0-47fb-9e0e-4e3cd7bc4edf'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:44 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:44 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:44 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552" returned: 0 in 1.152s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] <== create_volume: return (2869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.873s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502ed564-81d3-42ef-ae7b-c86ed3115f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68fcb4e8-50f1-4350-86b8-82806964d552', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf71e5c4-37e6-48d7-8f38-9437ce1798dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:44 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Volume volume-68fcb4e8-50f1-4350-86b8-82806964d552 (68fcb4e8-50f1-4350-86b8-82806964d552): created successfully Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf71e5c4-37e6-48d7-8f38-9437ce1798dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (a52f8263-6650-42b6-9760-7fed32321c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:44 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-17d4284f-9062-4d20-afca-b2f152f3d1e5 tempest-VolumesActionsTest-1878978502 None] Created volume successfully. Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:45 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:45 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Acquiring lock "cinder-68fcb4e8-50f1-4350-86b8-82806964d552-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Lock "cinder-68fcb4e8-50f1-4350-86b8-82806964d552-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Acquiring lock "cinder-quobyte-68fcb4e8-50f1-4350-86b8-82806964d552" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Lock "cinder-quobyte-68fcb4e8-50f1-4350-86b8-82806964d552" acquired by "delete_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcb6115-e461-41e7-b9cf-d88b4fe0c9a1]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:45 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552 Apr 27 23:54:45 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:45 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.475s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:45 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Deleted volume successfully. Apr 27 23:54:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f36690c-fca8-4cff-a017-d31d2def6dc6 tempest-SnapshotDependencyTests-1189542126 None] Lock "cinder-b254ad09-1aec-4a1d-8861-bfd7d8f00611-delete_volume" released by "delete_volume" :: held 4.581s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:46 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.341s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:46 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:46 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552" returned: 0 in 1.125s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:46 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552 Apr 27 23:54:46 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:47 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-68fcb4e8-50f1-4350-86b8-82806964d552" returned: 0 in 0.642s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Lock "cinder-quobyte-68fcb4e8-50f1-4350-86b8-82806964d552" released by "delete_volume" :: held 1.849s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:47 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Created reservations ['606106c2-bd02-4090-b13b-37f2ad90a0a3', 'b127ca3d-756b-4f75-8150-acf867f5d894', '8d57af7f-1038-43cb-ae1f-79b7ba5cd043', '6f447172-8ab7-4606-ae17-0bee08b1ae74'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:47 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:47 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:48 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.873s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:48 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Deleted volume successfully. Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8f245419-3171-46b3-a8c7-585ef615aba1 tempest-VolumesActionsTest-478292297 None] Lock "cinder-68fcb4e8-50f1-4350-86b8-82806964d552-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (bab3e018-2013-479f-aa75-51b002bf2d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422a92bd-dc6c-4a5c-a215-386649414023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422a92bd-dc6c-4a5c-a215-386649414023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-122443619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fce9342-fdc7-4f12-9c6d-a7af8f620334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:48Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c227b6a-f065-4f38-87ee-b4f8c5e23d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c227b6a-f065-4f38-87ee-b4f8c5e23d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6bd6db-bb38-4795-be18-153ebd16af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6bd6db-bb38-4795-be18-153ebd16af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fce9342-fdc7-4f12-9c6d-a7af8f620334', 'volume_name': 'volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f874d9ec-8ad6-4b38-bf53-cc36158a135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f874d9ec-8ad6-4b38-bf53-cc36158a135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb562db-806d-4e17-844c-450f9fd99e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:48 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Volume 9fce9342-fdc7-4f12-9c6d-a7af8f620334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334', 'volume_size': 1} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-122443619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fce9342-fdc7-4f12-9c6d-a7af8f620334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:48Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Creating volume 9fce9342-fdc7-4f12-9c6d-a7af8f620334 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:48 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:48 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 1073741824 Apr 27 23:54:48 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:49 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 1073741824" returned: 0 in 0.865s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:49 devstack sudo[86009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 Apr 27 23:54:49 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:49 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:54:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb562db-806d-4e17-844c-450f9fd99e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1834f3e-fdaf-44a4-a373-8cb61ecd1b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:49 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Volume volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 (9fce9342-fdc7-4f12-9c6d-a7af8f620334): created successfully Apr 27 23:54:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1834f3e-fdaf-44a4-a373-8cb61ecd1b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (bab3e018-2013-479f-aa75-51b002bf2d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:50 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-bd8e7c79-934f-480c-88d1-d6eed58062b4 tempest-VolumesActionsTest-1878978502 None] Created volume successfully. Apr 27 23:54:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Acquiring lock "cinder-9fce9342-fdc7-4f12-9c6d-a7af8f620334-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Lock "cinder-9fce9342-fdc7-4f12-9c6d-a7af8f620334-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Acquiring lock "cinder-quobyte-9fce9342-fdc7-4f12-9c6d-a7af8f620334" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Lock "cinder-quobyte-9fce9342-fdc7-4f12-9c6d-a7af8f620334" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d88dff-6ff7-448f-a6a3-f239ce60ef9b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:51 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 Apr 27 23:54:51 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:51 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334" returned: 0 in 0.627s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:51 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334 Apr 27 23:54:51 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:52 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9fce9342-fdc7-4f12-9c6d-a7af8f620334" returned: 0 in 0.631s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Lock "cinder-quobyte-9fce9342-fdc7-4f12-9c6d-a7af8f620334" released by "delete_volume" :: held 1.324s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=86,cinder:UPDATE=127,cinder:INSERT=27,cinder:DELETE=7 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=83,cinder:UPDATE=97,cinder:INSERT=25,cinder:DELETE=13 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Created reservations ['ae2fc3ca-af99-4294-a24f-45fb8b2b6e14', '35ad90f8-9fbf-4b7b-981a-8b9b67c8f5f1', 'ed67e9a5-6de0-4916-9af4-a0f94bad7cd6', 'd5db59bc-317f-4e17-974e-c1dce62723fe'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:52 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:52 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:53 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.803s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Deleted volume successfully. Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ab68b64-46a1-4ed6-abaf-d49e3c7a8518 tempest-VolumesActionsTest-478292297 None] Lock "cinder-9fce9342-fdc7-4f12-9c6d-a7af8f620334-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (d1950edd-4a7c-4883-a7e9-488567021fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d630b01-b344-4616-bb01-0cee7bed5938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d630b01-b344-4616-bb01-0cee7bed5938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1451201737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac3ee14-6910-4162-a85d-f659ecec39ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:54Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65feb7db-3b1b-4532-9389-df5ee5e6d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65feb7db-3b1b-4532-9389-df5ee5e6d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320d7344-d64a-4df8-a1ec-0a5a63d2dfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320d7344-d64a-4df8-a1ec-0a5a63d2dfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac3ee14-6910-4162-a85d-f659ecec39ed', 'volume_name': 'volume-9ac3ee14-6910-4162-a85d-f659ecec39ed', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24984142-ec76-4f84-a341-553c414bca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24984142-ec76-4f84-a341-553c414bca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325b30d6-463e-49b6-8ab9-e8480ed89d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:53 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Volume 9ac3ee14-6910-4162-a85d-f659ecec39ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac3ee14-6910-4162-a85d-f659ecec39ed', 'volume_size': 1} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1451201737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac3ee14-6910-4162-a85d-f659ecec39ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:54Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Creating volume 9ac3ee14-6910-4162-a85d-f659ecec39ed {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:53 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:53 devstack sudo[86053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed 1073741824 Apr 27 23:54:53 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:54 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed 1073741824" returned: 0 in 0.750s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:54 devstack sudo[86059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed Apr 27 23:54:54 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:55 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed" returned: 0 in 0.575s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:54:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325b30d6-463e-49b6-8ab9-e8480ed89d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac3ee14-6910-4162-a85d-f659ecec39ed', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1a3818-4e3c-431d-9ae1-22ec00f18c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:55 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Volume volume-9ac3ee14-6910-4162-a85d-f659ecec39ed (9ac3ee14-6910-4162-a85d-f659ecec39ed): created successfully Apr 27 23:54:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1a3818-4e3c-431d-9ae1-22ec00f18c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (d1950edd-4a7c-4883-a7e9-488567021fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:55 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f7b3cc8f-3c42-462a-a7a8-ee678312b93e tempest-VolumesActionsTest-1878978502 None] Created volume successfully. Apr 27 23:54:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Acquiring lock "cinder-9ac3ee14-6910-4162-a85d-f659ecec39ed-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Lock "cinder-9ac3ee14-6910-4162-a85d-f659ecec39ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Acquiring lock "cinder-quobyte-9ac3ee14-6910-4162-a85d-f659ecec39ed" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:54:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Lock "cinder-quobyte-9ac3ee14-6910-4162-a85d-f659ecec39ed" acquired by "delete_volume" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:54:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[866965bb-7a75-4c61-aef7-18f6a67c79d9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:54:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:56 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed Apr 27 23:54:56 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:56 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed" returned: 0 in 0.674s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:56 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed Apr 27 23:54:56 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:57 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9ac3ee14-6910-4162-a85d-f659ecec39ed" returned: 0 in 0.646s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Lock "cinder-quobyte-9ac3ee14-6910-4162-a85d-f659ecec39ed" released by "delete_volume" :: held 1.384s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:57 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Created reservations ['8fbd10be-3276-4475-b387-cc261d710ada', '67d6d042-09d1-4819-8811-8008f6047374', '26a9325f-4b1b-4a98-a5bd-3b6d1a5c9736', 'ce3e7ddb-9ef2-4073-8cde-8857829d8c72'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:54:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:57 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:54:57 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:58 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.707s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:54:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Deleted volume successfully. Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f41c5ecd-e3be-4818-a382-ceddff1b83f6 tempest-VolumesActionsTest-478292297 None] Lock "cinder-9ac3ee14-6910-4162-a85d-f659ecec39ed-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (ccdb3cf5-c0d9-4c1a-a01c-98868cce6774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1069cf9a-4cb3-4211-98d3-92f2f0cd3b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1069cf9a-4cb3-4211-98d3-92f2f0cd3b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1429507653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bae0fc2-78f5-422c-8e1b-5a9135b439b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:59Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb4721a-9475-44f6-a8ed-df2102ae52eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb4721a-9475-44f6-a8ed-df2102ae52eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ad476-5319-4054-ad76-609c3f639c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ad476-5319-4054-ad76-609c3f639c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bae0fc2-78f5-422c-8e1b-5a9135b439b7', 'volume_name': 'volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3823837-340e-4600-a4e8-d466d42ec753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3823837-340e-4600-a4e8-d466d42ec753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89b9ad5-dc39-4eff-8fe7-fd8a825b1aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:54:58 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Volume 5bae0fc2-78f5-422c-8e1b-5a9135b439b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7', 'volume_size': 1} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1429507653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bae0fc2-78f5-422c-8e1b-5a9135b439b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cd129b609b4d569efad6b9f331f5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:54:59Z,use_quota=True,user_id='f625d6f8df844b0488996504fc06cb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Creating volume 5bae0fc2-78f5-422c-8e1b-5a9135b439b7 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:54:58 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:54:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:59 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 1073741824 Apr 27 23:54:59 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:54:59 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 27 23:54:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 1073741824" returned: 0 in 0.933s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:54:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:54:59 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 Apr 27 23:54:59 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:00 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7" returned: 0 in 0.530s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:55:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89b9ad5-dc39-4eff-8fe7-fd8a825b1aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1a2210-d03b-404e-8244-bd230203f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:00 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Volume volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 (5bae0fc2-78f5-422c-8e1b-5a9135b439b7): created successfully Apr 27 23:55:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1a2210-d03b-404e-8244-bd230203f043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Flow 'volume_create_manager' (ccdb3cf5-c0d9-4c1a-a01c-98868cce6774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-51087fd0-449b-4632-8ef2-23bb0357db44 tempest-VolumesActionsTest-1878978502 None] Created volume successfully. Apr 27 23:55:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "cinder-5bae0fc2-78f5-422c-8e1b-5a9135b439b7-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-5bae0fc2-78f5-422c-8e1b-5a9135b439b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "cinder-quobyte-5bae0fc2-78f5-422c-8e1b-5a9135b439b7" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-quobyte-5bae0fc2-78f5-422c-8e1b-5a9135b439b7" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:01 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d2c2f-07ee-46ca-8549-4e121e312177]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:55:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:02 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 Apr 27 23:55:02 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:55:02 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Flow 'volume_create_manager' (de2870f8-d359-4634-8e96-246405ff362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0923449-8094-461d-81eb-edd75398d394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7" returned: 0 in 0.665s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0923449-8094-461d-81eb-edd75398d394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1942958333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d38485b-b4fd-44b1-9acc-292b7cf0f3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404a58aad1479cb8a1c1c23fe002a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:03Z,use_quota=True,user_id='c155e8a84733462b91b0a39ba5715a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:02 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7 Apr 27 23:55:02 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3839e6-45ec-4bd5-9b8b-d09f575f6acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3839e6-45ec-4bd5-9b8b-d09f575f6acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccca0f1-d016-4f7b-b94f-f0b23f1868e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccca0f1-d016-4f7b-b94f-f0b23f1868e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d38485b-b4fd-44b1-9acc-292b7cf0f3d0', 'volume_name': 'volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b842b8c4-5c04-44a9-a539-5cf85c68ee35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b842b8c4-5c04-44a9-a539-5cf85c68ee35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c2f3a3-d0dc-458e-b1d6-61b7fdbe4954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:02 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Volume 9d38485b-b4fd-44b1-9acc-292b7cf0f3d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0', 'volume_size': 1} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1942958333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d38485b-b4fd-44b1-9acc-292b7cf0f3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3404a58aad1479cb8a1c1c23fe002a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:03Z,use_quota=True,user_id='c155e8a84733462b91b0a39ba5715a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Creating volume 9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:55:02 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:55:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:02 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 1073741824 Apr 27 23:55:02 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:03 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-5bae0fc2-78f5-422c-8e1b-5a9135b439b7" returned: 0 in 0.584s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-quobyte-5bae0fc2-78f5-422c-8e1b-5a9135b439b7" released by "delete_volume" :: held 1.299s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Created reservations ['627a780c-4046-43e9-b794-6f44a728346b', '467ee622-4849-486e-96b3-8bd48174428b', '8de09bf6-4ebb-4f9f-8811-e0470b69abe2', '8e94b963-b00f-4b2a-a6dc-5de86dbb58fd'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:03 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:55:03 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:03 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 1073741824" returned: 0 in 0.767s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:03 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 Apr 27 23:55:03 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:03 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.539s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:55:03 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Deleted volume successfully. Apr 27 23:55:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-195d2903-4b73-4b71-8fcd-5b93fa082c27 tempest-VolumesActionsTest-1878978502 None] Lock "cinder-5bae0fc2-78f5-422c-8e1b-5a9135b439b7-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:04 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" returned: 0 in 0.722s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:55:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c2f3a3-d0dc-458e-b1d6-61b7fdbe4954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ade3201-8b89-445e-a4af-2f4c3e0e58f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:04 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Volume volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 (9d38485b-b4fd-44b1-9acc-292b7cf0f3d0): created successfully Apr 27 23:55:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ade3201-8b89-445e-a4af-2f4c3e0e58f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Flow 'volume_create_manager' (de2870f8-d359-4634-8e96-246405ff362f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:04 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-23900eeb-60f9-4ca3-bd93-e029f471e2cd tempest-VolumesActionsTest-1621829159 None] Created volume successfully. Apr 27 23:55:16 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=37,cinder:DELETE=4 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:55:16 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:INSERT=7,cinder:UPDATE=29,cinder:SELECT=16,cinder:DELETE=2 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:55:18 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:55:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Flow 'volume_create_manager' (c3531adb-46e3-49fe-8b09-e591bda51190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c292cdf5-50ba-4465-a8c3-249d4aafb2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c292cdf5-50ba-4465-a8c3-249d4aafb2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1679550539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d717b9b-2b4d-4c00-99fc-39953fe4ea46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473f0d14d47f472c99b0b289a894d7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:19Z,use_quota=True,user_id='bfe880fd0bb248f79c6c985fd31c8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b98c09-9827-4d5e-9dd6-c78100c8c80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b98c09-9827-4d5e-9dd6-c78100c8c80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fd908d-df88-4d9e-a7e8-a735d0b2a2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fd908d-df88-4d9e-a7e8-a735d0b2a2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d717b9b-2b4d-4c00-99fc-39953fe4ea46', 'volume_name': 'volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca6bcf9-a6d2-4728-8685-fe8948dbf662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca6bcf9-a6d2-4728-8685-fe8948dbf662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbe9a34-ee99-4b3f-9e26-d8080a91e5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:19 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Volume 8d717b9b-2b4d-4c00-99fc-39953fe4ea46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46', 'volume_size': 1} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1679550539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d717b9b-2b4d-4c00-99fc-39953fe4ea46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473f0d14d47f472c99b0b289a894d7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:19Z,use_quota=True,user_id='bfe880fd0bb248f79c6c985fd31c8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Creating volume 8d717b9b-2b4d-4c00-99fc-39953fe4ea46 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:55:19 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:19 devstack sudo[86290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 1073741824 Apr 27 23:55:19 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:19 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 1073741824" returned: 0 in 0.667s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:19 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 Apr 27 23:55:19 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:20 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46" returned: 0 in 0.527s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:55:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbe9a34-ee99-4b3f-9e26-d8080a91e5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b5643e-31b1-4398-b83b-3e5de9b84aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:20 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Volume volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 (8d717b9b-2b4d-4c00-99fc-39953fe4ea46): created successfully Apr 27 23:55:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b5643e-31b1-4398-b83b-3e5de9b84aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Flow 'volume_create_manager' (c3531adb-46e3-49fe-8b09-e591bda51190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:20 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-65293228-b258-4c6a-a4aa-07135aa80b85 tempest-VolumesListAdminTestJSON-844715635 None] Created volume successfully. Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Flow 'volume_create_manager' (989721d7-c965-4b31-94a8-b83a24771665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebac9184-f0d9-4349-aff0-9932e84d4b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebac9184-f0d9-4349-aff0-9932e84d4b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-184161187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115f0ffb-2405-4a17-afbf-e25a5bfd5775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473f0d14d47f472c99b0b289a894d7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:22Z,use_quota=True,user_id='bfe880fd0bb248f79c6c985fd31c8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a859861-73d0-4231-83fb-b51226a27d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a859861-73d0-4231-83fb-b51226a27d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d5a3e9-b6ad-4302-b793-4f9cd34b87f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d5a3e9-b6ad-4302-b793-4f9cd34b87f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '115f0ffb-2405-4a17-afbf-e25a5bfd5775', 'volume_name': 'volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dd42b6-39bd-4360-9bea-268fc2eae0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dd42b6-39bd-4360-9bea-268fc2eae0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19eb48b8-eb85-4581-872d-192eaee16945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:21 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Volume 115f0ffb-2405-4a17-afbf-e25a5bfd5775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775', 'volume_size': 1} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-184161187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115f0ffb-2405-4a17-afbf-e25a5bfd5775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473f0d14d47f472c99b0b289a894d7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:22Z,use_quota=True,user_id='bfe880fd0bb248f79c6c985fd31c8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Creating volume 115f0ffb-2405-4a17-afbf-e25a5bfd5775 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:55:21 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:55:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:21 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 1073741824 Apr 27 23:55:21 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:22 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 1073741824" returned: 0 in 0.740s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:22 devstack sudo[86405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 Apr 27 23:55:22 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:23 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775" returned: 0 in 0.610s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:55:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19eb48b8-eb85-4581-872d-192eaee16945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bda2f6c-89ff-4dd0-89dd-8350be185124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:23 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Volume volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 (115f0ffb-2405-4a17-afbf-e25a5bfd5775): created successfully Apr 27 23:55:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bda2f6c-89ff-4dd0-89dd-8350be185124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Flow 'volume_create_manager' (989721d7-c965-4b31-94a8-b83a24771665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:23 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d7e12589-773b-496c-aea5-369c4e2810a0 tempest-VolumesListAdminTestJSON-844715635 None] Created volume successfully. Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Flow 'volume_create_manager' (dac2aa35-9fc5-4381-b5ec-c5e781a30bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367852d5-ca6b-4618-9eb8-162f8974bcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367852d5-ca6b-4618-9eb8-162f8974bcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-423263867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247b98cf-b269-4be6-87a7-6dbb1c25e8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473f0d14d47f472c99b0b289a894d7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:24Z,use_quota=True,user_id='bfe880fd0bb248f79c6c985fd31c8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee3f6b9-3150-41c1-8410-6d5b6ce118f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee3f6b9-3150-41c1-8410-6d5b6ce118f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef39ef40-de1c-4277-8d57-159c0ffa185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef39ef40-de1c-4277-8d57-159c0ffa185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247b98cf-b269-4be6-87a7-6dbb1c25e8bc', 'volume_name': 'volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deadde8f-1ce0-4ca0-a31c-143f8542a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deadde8f-1ce0-4ca0-a31c-143f8542a081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7d34c2-5f5a-4a84-95b6-e393a5317e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:24 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Volume 247b98cf-b269-4be6-87a7-6dbb1c25e8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc', 'volume_size': 1} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-423263867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247b98cf-b269-4be6-87a7-6dbb1c25e8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473f0d14d47f472c99b0b289a894d7ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:24Z,use_quota=True,user_id='bfe880fd0bb248f79c6c985fd31c8f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Creating volume 247b98cf-b269-4be6-87a7-6dbb1c25e8bc {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:55:24 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:55:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:24 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc 1073741824 Apr 27 23:55:24 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:25 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc 1073741824" returned: 0 in 0.706s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:25 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc Apr 27 23:55:25 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:25 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc" returned: 0 in 0.478s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:55:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7d34c2-5f5a-4a84-95b6-e393a5317e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c3e0cd-40ea-4205-95b2-436485a4661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:25 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Volume volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc (247b98cf-b269-4be6-87a7-6dbb1c25e8bc): created successfully Apr 27 23:55:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c3e0cd-40ea-4205-95b2-436485a4661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Flow 'volume_create_manager' (dac2aa35-9fc5-4381-b5ec-c5e781a30bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:25 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-341d627d-491f-4928-8e31-5f80a294a10b tempest-VolumesListAdminTestJSON-844715635 None] Created volume successfully. Apr 27 23:55:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f78e8337-b801-4619-af98-6683616a7372 tempest-VolumesActionsTest-1621829159 None] Acquiring lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" by "attach_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f78e8337-b801-4619-af98-6683616a7372 tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" acquired by "attach_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f78e8337-b801-4619-af98-6683616a7372 tempest-VolumesActionsTest-1621829159 None] Attaching volume 9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 to instance 2522f1fa-d92d-49b7-a688-a4183a35bb29 at mountpoint /dev/vdb on host None. Apr 27 23:55:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f78e8337-b801-4619-af98-6683616a7372 tempest-VolumesActionsTest-1621829159 None] Attach volume completed successfully. Apr 27 23:55:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f78e8337-b801-4619-af98-6683616a7372 tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" released by "attach_volume" :: held 0.080s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-314cb219-aad7-481e-bb4c-d4476dea6797 tempest-VolumesActionsTest-1621829159 None] Acquiring lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0-detach_volume" by "detach_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-314cb219-aad7-481e-bb4c-d4476dea6797 tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-314cb219-aad7-481e-bb4c-d4476dea6797 tempest-VolumesActionsTest-1621829159 None] Detaching volume 9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 from instance 2522f1fa-d92d-49b7-a688-a4183a35bb29. Apr 27 23:55:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-314cb219-aad7-481e-bb4c-d4476dea6797 tempest-VolumesActionsTest-1621829159 None] Detach volume completed successfully. Apr 27 23:55:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-314cb219-aad7-481e-bb4c-d4476dea6797 tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Flow 'volume_create_manager' (a212381b-a50b-4ddb-8f2a-13623697d327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861a8962-5a8b-455b-a26f-839fc049e4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861a8962-5a8b-455b-a26f-839fc049e4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2940840a-0eb5-46ec-a789-fa4df958f381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ed5ab9f28b4e70b301654f2f093fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:27Z,use_quota=True,user_id='4f6bd6c700394b7483640a4ae108e9ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7052978f-c223-4672-8a56-83416d1a47db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7052978f-c223-4672-8a56-83416d1a47db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c204cfc1-f1b3-4a68-bc37-8cb1e47f46d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c204cfc1-f1b3-4a68-bc37-8cb1e47f46d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2940840a-0eb5-46ec-a789-fa4df958f381', 'volume_name': 'volume-2940840a-0eb5-46ec-a789-fa4df958f381', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcb8545-d6ae-4d79-8619-beec6222770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcb8545-d6ae-4d79-8619-beec6222770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71a5398-f499-4944-863a-df9326a11d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:27 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Volume 2940840a-0eb5-46ec-a789-fa4df958f381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2940840a-0eb5-46ec-a789-fa4df958f381', 'volume_size': 1} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2940840a-0eb5-46ec-a789-fa4df958f381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ed5ab9f28b4e70b301654f2f093fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:27Z,use_quota=True,user_id='4f6bd6c700394b7483640a4ae108e9ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Creating volume 2940840a-0eb5-46ec-a789-fa4df958f381 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:55:27 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:55:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:27 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381 1073741824 Apr 27 23:55:27 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:28 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381 1073741824" returned: 0 in 0.796s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:28 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381 Apr 27 23:55:28 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:28 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:55:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71a5398-f499-4944-863a-df9326a11d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2940840a-0eb5-46ec-a789-fa4df958f381', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273a04a2-865c-408e-b0e7-2fe25c79a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:28 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Volume volume-2940840a-0eb5-46ec-a789-fa4df958f381 (2940840a-0eb5-46ec-a789-fa4df958f381): created successfully Apr 27 23:55:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273a04a2-865c-408e-b0e7-2fe25c79a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Flow 'volume_create_manager' (a212381b-a50b-4ddb-8f2a-13623697d327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:28 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-07fcbe29-d5b7-48eb-bee0-184587ef8183 tempest-VolumesListAdminTestJSON-930808451 None] Created volume successfully. Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Acquiring lock "cinder-2940840a-0eb5-46ec-a789-fa4df958f381-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Lock "cinder-2940840a-0eb5-46ec-a789-fa4df958f381-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Acquiring lock "cinder-quobyte-2940840a-0eb5-46ec-a789-fa4df958f381" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Lock "cinder-quobyte-2940840a-0eb5-46ec-a789-fa4df958f381" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5182093a-501e-4f03-85e3-ee61939595ce]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "cinder-247b98cf-b269-4be6-87a7-6dbb1c25e8bc-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-247b98cf-b269-4be6-87a7-6dbb1c25e8bc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:29 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381 Apr 27 23:55:29 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "cinder-quobyte-247b98cf-b269-4be6-87a7-6dbb1c25e8bc" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-quobyte-247b98cf-b269-4be6-87a7-6dbb1c25e8bc" acquired by "delete_volume" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b004c18-e2ad-4df2-8fdc-54199615af18]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:55:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:29 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc Apr 27 23:55:29 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:30 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381" returned: 0 in 0.660s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:30 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381 Apr 27 23:55:30 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:30 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc" returned: 0 in 0.615s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:30 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc Apr 27 23:55:30 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:30 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2940840a-0eb5-46ec-a789-fa4df958f381" returned: 0 in 0.795s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Lock "cinder-quobyte-2940840a-0eb5-46ec-a789-fa4df958f381" released by "delete_volume" :: held 1.504s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Created reservations ['b94ee239-3d24-482e-8b71-550ce55915ce', 'dc48d45d-4fbd-493d-8b9d-b114849eec70', '39afd9d9-f412-4fc3-91df-db32005c553d', '9afb9a84-aabb-476d-a7bf-0405b3659702'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:31 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-247b98cf-b269-4be6-87a7-6dbb1c25e8bc" returned: 0 in 0.889s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:31 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:55:31 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-quobyte-247b98cf-b269-4be6-87a7-6dbb1c25e8bc" released by "delete_volume" :: held 1.560s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Created reservations ['3a180b75-6b12-4364-80cb-23f94be20eda', '89af36ff-1a0d-4b0e-b53e-68213e0c952b', 'c5235d73-ac31-47e6-9539-6a59c58212e8', '0b1c2081-77a9-43da-8262-41a7710d1054'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:31 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:55:31 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:31 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.755s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:31 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:55:31 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Deleted volume successfully. Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e2f1e8d-190c-4d3a-a6e8-5c3801e0792c tempest-VolumesListAdminTestJSON-930808451 None] Lock "cinder-2940840a-0eb5-46ec-a789-fa4df958f381-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "cinder-115f0ffb-2405-4a17-afbf-e25a5bfd5775-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-115f0ffb-2405-4a17-afbf-e25a5bfd5775-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:32 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.646s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:55:32 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Deleted volume successfully. Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "cinder-quobyte-115f0ffb-2405-4a17-afbf-e25a5bfd5775" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2c3fd77c-8be3-479a-83dc-5a5c656add70 tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-247b98cf-b269-4be6-87a7-6dbb1c25e8bc-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-quobyte-115f0ffb-2405-4a17-afbf-e25a5bfd5775" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b6807-e3f3-41dc-a313-f52c51041f55]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:32 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 Apr 27 23:55:32 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:32 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775" returned: 0 in 0.664s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:32 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775 Apr 27 23:55:32 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:33 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-115f0ffb-2405-4a17-afbf-e25a5bfd5775" returned: 0 in 0.521s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-quobyte-115f0ffb-2405-4a17-afbf-e25a5bfd5775" released by "delete_volume" :: held 1.245s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:33 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Created reservations ['96dd8315-265e-43bd-ab82-ee08b68e298c', '215e4b80-dd5f-4e31-8350-1c4162f54225', 'ac95438e-594d-4d1b-8c13-461a3d72fc7d', '808c6087-0900-4269-9ebf-43d8da7aa49f'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:55:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:33 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:55:33 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:34 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.557s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:34 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:55:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Deleted volume successfully. Apr 27 23:55:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28c0640e-5066-4649-854a-fc9174d077e8 tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-115f0ffb-2405-4a17-afbf-e25a5bfd5775-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "cinder-8d717b9b-2b4d-4c00-99fc-39953fe4ea46-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-8d717b9b-2b4d-4c00-99fc-39953fe4ea46-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "cinder-quobyte-8d717b9b-2b4d-4c00-99fc-39953fe4ea46" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-quobyte-8d717b9b-2b4d-4c00-99fc-39953fe4ea46" acquired by "delete_volume" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:34 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5c0a39-add1-488b-b813-587967050118]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:55:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:34 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 Apr 27 23:55:34 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:35 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46" returned: 0 in 0.795s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:35 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46 Apr 27 23:55:35 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:35 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8d717b9b-2b4d-4c00-99fc-39953fe4ea46" returned: 0 in 0.568s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-quobyte-8d717b9b-2b4d-4c00-99fc-39953fe4ea46" released by "delete_volume" :: held 1.431s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:35 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Created reservations ['43616a84-3983-4497-a109-5c3c8b01ffad', 'e34e7ffa-de00-48fc-8c4a-6e75089162f4', '8ef31fe3-27b8-4e5a-a8d9-25357c163d7c', '837fe5e3-01ea-46a6-8da9-1451d66c5c06'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:55:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:36 devstack sudo[86614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:55:36 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:36 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.549s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:36 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:55:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Deleted volume successfully. Apr 27 23:55:36 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3e33f5a7-35a0-4e0a-986b-bdf51661dddf tempest-VolumesListAdminTestJSON-844715635 None] Lock "cinder-8d717b9b-2b4d-4c00-99fc-39953fe4ea46-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Flow 'volume_create_manager' (134487bf-33e1-4f5b-bcfe-d6452b6f0111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ca00d9-b799-4dfc-bc36-e1e85a52abcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ca00d9-b799-4dfc-bc36-e1e85a52abcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-734876885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4730cf26-cc6e-498d-84f6-fa4856179960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4bc10c144146abb60e7d574630d41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:41Z,use_quota=True,user_id='97c51ed2c1cc4f9fb41a21b533a628b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2344bc6c-503b-44d4-8628-ccabc44c86c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2344bc6c-503b-44d4-8628-ccabc44c86c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45cae9dd-5b9a-4cba-908b-f88e51587dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45cae9dd-5b9a-4cba-908b-f88e51587dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4730cf26-cc6e-498d-84f6-fa4856179960', 'volume_name': 'volume-4730cf26-cc6e-498d-84f6-fa4856179960', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b14aefd-894a-485f-836f-484781d3d80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b14aefd-894a-485f-836f-484781d3d80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30abb181-fb67-49ad-b45d-7a7b550158fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:41 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Volume 4730cf26-cc6e-498d-84f6-fa4856179960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4730cf26-cc6e-498d-84f6-fa4856179960', 'volume_size': 1} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-734876885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4730cf26-cc6e-498d-84f6-fa4856179960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4bc10c144146abb60e7d574630d41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:41Z,use_quota=True,user_id='97c51ed2c1cc4f9fb41a21b533a628b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Creating volume 4730cf26-cc6e-498d-84f6-fa4856179960 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:55:41 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:55:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:41 devstack sudo[86655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960 1073741824 Apr 27 23:55:41 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:42 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960 1073741824" returned: 0 in 1.264s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:42 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960 Apr 27 23:55:42 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:43 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960" returned: 0 in 0.616s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:55:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:43 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30abb181-fb67-49ad-b45d-7a7b550158fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4730cf26-cc6e-498d-84f6-fa4856179960', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:43 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242acfaf-a331-4496-9318-c9f74d36e3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:43 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Volume volume-4730cf26-cc6e-498d-84f6-fa4856179960 (4730cf26-cc6e-498d-84f6-fa4856179960): created successfully Apr 27 23:55:43 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242acfaf-a331-4496-9318-c9f74d36e3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:43 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Flow 'volume_create_manager' (134487bf-33e1-4f5b-bcfe-d6452b6f0111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:43 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-73aa772c-be2e-40a7-97d0-ec49d06b50ea tempest-VolumesMetadataTest-1494965946 None] Created volume successfully. Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:45 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:55:45 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Acquiring lock "cinder-4730cf26-cc6e-498d-84f6-fa4856179960-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Lock "cinder-4730cf26-cc6e-498d-84f6-fa4856179960-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Acquiring lock "cinder-quobyte-4730cf26-cc6e-498d-84f6-fa4856179960" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Lock "cinder-quobyte-4730cf26-cc6e-498d-84f6-fa4856179960" acquired by "delete_volume" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ec191-551d-4155-b38a-f674c81429a5]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:45 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960 Apr 27 23:55:45 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:45 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.627s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:55:45 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960" returned: 0 in 0.608s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:45 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960 Apr 27 23:55:45 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:46 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4730cf26-cc6e-498d-84f6-fa4856179960" returned: 0 in 0.461s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Lock "cinder-quobyte-4730cf26-cc6e-498d-84f6-fa4856179960" released by "delete_volume" :: held 1.132s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:46 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Created reservations ['150e72d0-2e12-44c6-ba5d-3a21f1e4a984', '99aeabf1-2034-4f9d-b650-7350ede50ff0', 'b95c2088-d693-489e-816e-064b361ae601', '2b9316bc-cfac-49a4-98b2-798d713a29b4'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:55:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:46 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:55:46 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:47 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:47 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:55:47 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Deleted volume successfully. Apr 27 23:55:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-4d44dd6c-64fb-4b4b-bcf8-02777e724e83 tempest-VolumesMetadataTest-1494965946 None] Lock "cinder-4730cf26-cc6e-498d-84f6-fa4856179960-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Flow 'volume_create_manager' (8d7cc1c2-edb7-4d07-a8a6-253f994a95c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d52933-8930-45ff-ae6b-238260882129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d52933-8930-45ff-ae6b-238260882129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1281970177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e7d8c223c7489c93c6b32883a144ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:52Z,use_quota=True,user_id='df2f617f4b0e44cd9c137dc21c6244d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24a63b9-42cf-4f3a-8e74-465fdd569ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24a63b9-42cf-4f3a-8e74-465fdd569ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0287be16-cdd7-43a6-9e26-1c457c6200be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0287be16-cdd7-43a6-9e26-1c457c6200be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c', 'volume_name': 'volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b91096-bc6a-44a9-99cf-2171b443a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b91096-bc6a-44a9-99cf-2171b443a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf45329-a301-4f94-b199-c032883f0b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:52 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Volume 2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c', 'volume_size': 1} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1281970177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e7d8c223c7489c93c6b32883a144ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:52Z,use_quota=True,user_id='df2f617f4b0e44cd9c137dc21c6244d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Creating volume 2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:55:52 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:52 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c 1073741824 Apr 27 23:55:52 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:52 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c 1073741824" returned: 0 in 0.695s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:53 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c Apr 27 23:55:53 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:53 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c" returned: 0 in 0.673s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:55:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf45329-a301-4f94-b199-c032883f0b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72db3052-37ef-41be-9f90-bddbc0255331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:53 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Volume volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c (2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c): created successfully Apr 27 23:55:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72db3052-37ef-41be-9f90-bddbc0255331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Flow 'volume_create_manager' (8d7cc1c2-edb7-4d07-a8a6-253f994a95c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6c41d3b6-afa9-408b-b64b-d4b2e5215567 tempest-VolumesTransfersV357Test-1822625538 None] Created volume successfully. Apr 27 23:55:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-df1c87b4-13c9-4963-a823-70ba693c72b0 tempest-VolumesActionsTest-1621829159 None] Acquiring lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" by "attach_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-df1c87b4-13c9-4963-a823-70ba693c72b0 tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" acquired by "attach_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:54 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-df1c87b4-13c9-4963-a823-70ba693c72b0 tempest-VolumesActionsTest-1621829159 None] Attaching volume 9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 to instance dc71f753-2d78-421e-b10c-6d8e4e357a40 at mountpoint /dev/vdb on host None. Apr 27 23:55:54 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-df1c87b4-13c9-4963-a823-70ba693c72b0 tempest-VolumesActionsTest-1621829159 None] Attach volume completed successfully. Apr 27 23:55:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-df1c87b4-13c9-4963-a823-70ba693c72b0 tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" released by "attach_volume" :: held 0.109s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:55 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f2091f1d-97ac-4cb1-a0b6-c525bd5f023a tempest-VolumesTransfersV357Test-145937695 None] Transfer volume completed successfully. Apr 27 23:55:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0359d4fb-149a-4a5a-8c03-8e7e583397b5 tempest-VolumesActionsTest-1621829159 None] Acquiring lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0-detach_volume" by "detach_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0359d4fb-149a-4a5a-8c03-8e7e583397b5 tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:55 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0359d4fb-149a-4a5a-8c03-8e7e583397b5 tempest-VolumesActionsTest-1621829159 None] Detaching volume 9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 from instance dc71f753-2d78-421e-b10c-6d8e4e357a40. Apr 27 23:55:55 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0359d4fb-149a-4a5a-8c03-8e7e583397b5 tempest-VolumesActionsTest-1621829159 None] Detach volume completed successfully. Apr 27 23:55:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0359d4fb-149a-4a5a-8c03-8e7e583397b5 tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Acquiring lock "cinder-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Lock "cinder-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Acquiring lock "cinder-quobyte-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:55:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Lock "cinder-quobyte-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:55:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c337966d-f785-473f-a648-b94663d5caab]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:55:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:56 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c Apr 27 23:55:56 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:56 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c" returned: 0 in 0.626s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:56 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c Apr 27 23:55:56 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:57 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c" returned: 0 in 0.540s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Lock "cinder-quobyte-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c" released by "delete_volume" :: held 1.230s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:57 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Created reservations ['c8d3d6e2-d24c-43e5-8a7b-d5e418a3dc37', '0ef86d76-80a5-4013-83e9-7201447bd295', '2a3f418b-dba0-462d-b63f-f7772ce9e772', '4659416b-d2f5-4d6b-97f3-5e3cf9c08f46'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:55:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:57 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:55:57 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:58 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.620s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:55:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Deleted volume successfully. Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7454e2d1-1a82-4a5e-a501-81be22ee904a tempest-VolumesTransfersV357Test-1355551600 None] Lock "cinder-2a8ff8fd-1458-4a0e-a767-7f7cc5e9494c-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Flow 'volume_create_manager' (566999dc-834d-4775-8333-d4a3b207f327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a3c9dd-9d94-440b-b6b0-38c02b353f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a3c9dd-9d94-440b-b6b0-38c02b353f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1954547530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d20df3-ae8a-4434-ad67-b939227a3187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e7d8c223c7489c93c6b32883a144ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:59Z,use_quota=True,user_id='df2f617f4b0e44cd9c137dc21c6244d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ab4bb1-77e1-42d7-9cd3-88ea2d4d586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ab4bb1-77e1-42d7-9cd3-88ea2d4d586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4989245b-83d3-4345-96d2-e69c4963be10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4989245b-83d3-4345-96d2-e69c4963be10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d20df3-ae8a-4434-ad67-b939227a3187', 'volume_name': 'volume-25d20df3-ae8a-4434-ad67-b939227a3187', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c090444-4691-4776-a1e5-05d77f51ee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c090444-4691-4776-a1e5-05d77f51ee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95856cf-7eb9-49c6-8390-be39280bceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:55:58 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Volume 25d20df3-ae8a-4434-ad67-b939227a3187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d20df3-ae8a-4434-ad67-b939227a3187', 'volume_size': 1} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1954547530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d20df3-ae8a-4434-ad67-b939227a3187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e7d8c223c7489c93c6b32883a144ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:55:59Z,use_quota=True,user_id='df2f617f4b0e44cd9c137dc21c6244d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Creating volume 25d20df3-ae8a-4434-ad67-b939227a3187 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:55:58 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:55:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:58 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187 1073741824 Apr 27 23:55:58 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:55:59 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 27 23:55:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187 1073741824" returned: 0 in 0.678s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:55:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:55:59 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187 Apr 27 23:55:59 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:00 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187" returned: 0 in 0.490s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95856cf-7eb9-49c6-8390-be39280bceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d20df3-ae8a-4434-ad67-b939227a3187', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edf5505-88c1-45f2-b6f7-2a15480fc834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:00 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Volume volume-25d20df3-ae8a-4434-ad67-b939227a3187 (25d20df3-ae8a-4434-ad67-b939227a3187): created successfully Apr 27 23:56:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edf5505-88c1-45f2-b6f7-2a15480fc834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Flow 'volume_create_manager' (566999dc-834d-4775-8333-d4a3b207f327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0653fc3b-3c2c-4563-b547-97944a3547e0 tempest-VolumesTransfersV357Test-1822625538 None] Created volume successfully. Apr 27 23:56:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Acquiring lock "cinder-25d20df3-ae8a-4434-ad67-b939227a3187-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Lock "cinder-25d20df3-ae8a-4434-ad67-b939227a3187-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Acquiring lock "cinder-quobyte-25d20df3-ae8a-4434-ad67-b939227a3187" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Lock "cinder-quobyte-25d20df3-ae8a-4434-ad67-b939227a3187" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:01 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aca92a-60e9-4f36-9a8c-54adf31a8c2b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:01 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187 Apr 27 23:56:01 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:01 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187" returned: 0 in 0.576s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:01 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187 Apr 27 23:56:01 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Flow 'volume_create_manager' (823a76fc-5ca5-46cd-8cb1-6fad5bfb1618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd96f73-552c-47c9-a034-b1466db1d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd96f73-552c-47c9-a034-b1466db1d27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1898459128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f5b023-2fe0-4b40-9025-55410a01de6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc27a647d6074365ae6548f731ebd867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:02Z,use_quota=True,user_id='be565d60c5734fcfa9b455bac1ed093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a881deec-1681-44ae-a174-9a535b9e90b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a881deec-1681-44ae-a174-9a535b9e90b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b351de9-8b92-427b-8d03-313ae2994d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b351de9-8b92-427b-8d03-313ae2994d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f5b023-2fe0-4b40-9025-55410a01de6d', 'volume_name': 'volume-22f5b023-2fe0-4b40-9025-55410a01de6d', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758a87c4-f448-4008-8f11-175b92efbb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758a87c4-f448-4008-8f11-175b92efbb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a63d0e8-9ded-4d4a-a380-ca9bf7904bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:02 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Volume 22f5b023-2fe0-4b40-9025-55410a01de6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f5b023-2fe0-4b40-9025-55410a01de6d', 'volume_size': 1} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1898459128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f5b023-2fe0-4b40-9025-55410a01de6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc27a647d6074365ae6548f731ebd867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:02Z,use_quota=True,user_id='be565d60c5734fcfa9b455bac1ed093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Creating volume 22f5b023-2fe0-4b40-9025-55410a01de6d {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:02 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:02 devstack sudo[86933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d 1073741824 Apr 27 23:56:02 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:02 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-25d20df3-ae8a-4434-ad67-b939227a3187" returned: 0 in 0.556s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Lock "cinder-quobyte-25d20df3-ae8a-4434-ad67-b939227a3187" released by "delete_volume" :: held 1.178s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Created reservations ['a6535ff4-e67d-4578-8ed5-d60092e0c613', '505f67ea-ab20-4d84-9e9f-a5ff0f9e1bf6', '172fa8c4-2251-4c64-b349-a13ce6d12861', 'e0de1484-be10-4867-bc4e-20491830f1b2'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:02 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:02 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:03 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.509s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:03 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Deleted volume successfully. Apr 27 23:56:03 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d 1073741824" returned: 0 in 0.677s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0e88e927-2c91-44b9-8feb-fc69c9b0ac63 tempest-VolumesTransfersV357Test-1355551600 None] Lock "cinder-25d20df3-ae8a-4434-ad67-b939227a3187-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:03 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d Apr 27 23:56:03 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:03 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d" returned: 0 in 0.469s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a63d0e8-9ded-4d4a-a380-ca9bf7904bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f5b023-2fe0-4b40-9025-55410a01de6d', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e827d1de-1e70-4c78-a91f-e91d554b1ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:03 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Volume volume-22f5b023-2fe0-4b40-9025-55410a01de6d (22f5b023-2fe0-4b40-9025-55410a01de6d): created successfully Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e827d1de-1e70-4c78-a91f-e91d554b1ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Flow 'volume_create_manager' (823a76fc-5ca5-46cd-8cb1-6fad5bfb1618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:03 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-14e4e638-49cf-4a08-b71e-2727d77c4932 tempest-ServersNegativeTestJSON-37380410 None] Created volume successfully. Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Flow 'volume_create_manager' (29973c6f-fe05-466d-b762-849290d99249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cf3462-8537-4e96-a420-ed7a3d2681e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cf3462-8537-4e96-a420-ed7a3d2681e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2065896722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dceeab-0798-4a0f-b9ad-209dcc097f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc27a647d6074365ae6548f731ebd867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:06Z,use_quota=True,user_id='be565d60c5734fcfa9b455bac1ed093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565447e7-acad-43d1-849d-578434cf4933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565447e7-acad-43d1-849d-578434cf4933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525ff93c-2451-4a66-b232-5bdc5f11c3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525ff93c-2451-4a66-b232-5bdc5f11c3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59dceeab-0798-4a0f-b9ad-209dcc097f34', 'volume_name': 'volume-59dceeab-0798-4a0f-b9ad-209dcc097f34', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72769a3d-39b3-4af1-97ac-7e78b7ded147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72769a3d-39b3-4af1-97ac-7e78b7ded147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352e54f8-b7fe-40e2-a513-1b0a75ba49e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:05 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Volume 59dceeab-0798-4a0f-b9ad-209dcc097f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59dceeab-0798-4a0f-b9ad-209dcc097f34', 'volume_size': 1} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2065896722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dceeab-0798-4a0f-b9ad-209dcc097f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc27a647d6074365ae6548f731ebd867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:06Z,use_quota=True,user_id='be565d60c5734fcfa9b455bac1ed093b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Creating volume 59dceeab-0798-4a0f-b9ad-209dcc097f34 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:05 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:05 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 1073741824 Apr 27 23:56:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:05 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:06 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 1073741824" returned: 0 in 0.721s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:06 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 Apr 27 23:56:06 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:07 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34" returned: 0 in 0.539s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.264s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352e54f8-b7fe-40e2-a513-1b0a75ba49e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59dceeab-0798-4a0f-b9ad-209dcc097f34', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb10f5e-cb83-4906-9644-3e94eab270f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3ec9a4-3ca9-4ccf-abcc-593d38c83d11]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:07 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Volume volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 (59dceeab-0798-4a0f-b9ad-209dcc097f34): created successfully Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb10f5e-cb83-4906-9644-3e94eab270f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Flow 'volume_create_manager' (29973c6f-fe05-466d-b762-849290d99249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:07 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-59db5a2f-bc80-4513-a14e-3f1fc9152442 tempest-ServersNegativeTestJSON-37380410 None] Created volume successfully. Apr 27 23:56:07 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 Apr 27 23:56:07 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:07 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" returned: 0 in 0.656s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[66972c9d-0a5a-4568-85f9-c8713b194093]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:07 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 Apr 27 23:56:07 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "cinder-59dceeab-0798-4a0f-b9ad-209dcc097f34-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Lock "cinder-59dceeab-0798-4a0f-b9ad-209dcc097f34-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "cinder-quobyte-59dceeab-0798-4a0f-b9ad-209dcc097f34" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Lock "cinder-quobyte-59dceeab-0798-4a0f-b9ad-209dcc097f34" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa70dc74-0f03-446a-bd8f-78847247f179]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:08 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 Apr 27 23:56:08 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:08 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" returned: 0 in 0.671s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.c90fb634-ea24-46e9-aed3-294563957ba1fh1ryim2.img {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:08 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.c90fb634-ea24-46e9-aed3-294563957ba1fh1ryim2.img Apr 27 23:56:08 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Flow 'volume_create_manager' (6fd199cf-ebf2-41f3-a026-f1b59f2f3c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b335297c-473f-4cb3-b7de-63612e37ef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b335297c-473f-4cb3-b7de-63612e37ef1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-369715890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6412ac0e-dc65-4fb3-9d48-57232d57ead9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74229bab075146eca4b39225c492df3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:09Z,use_quota=True,user_id='ac1323270629464e807c4f3b93caf456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9293126-084c-4287-b6c2-7b394aa58b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9293126-084c-4287-b6c2-7b394aa58b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74714f4d-f4c1-40a0-8b21-e078831b15dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74714f4d-f4c1-40a0-8b21-e078831b15dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6412ac0e-dc65-4fb3-9d48-57232d57ead9', 'volume_name': 'volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9', 'volume_size': 2}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47058d09-51f1-47a7-9637-51c411719764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47058d09-51f1-47a7-9637-51c411719764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300b3f57-784c-4aae-805e-10b7f9f8702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:08 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Volume 6412ac0e-dc65-4fb3-9d48-57232d57ead9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9', 'volume_size': 2} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:08 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34" returned: 0 in 0.598s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:08 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34 Apr 27 23:56:08 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:09 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-59dceeab-0798-4a0f-b9ad-209dcc097f34" returned: 0 in 0.857s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Lock "cinder-quobyte-59dceeab-0798-4a0f-b9ad-209dcc097f34" released by "delete_volume" :: held 1.505s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:09 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Created reservations ['dc57f924-01bb-4081-be4a-1e3f86ed5e85', 'ff0c86a2-3040-48be-a517-4b4ce50cbfda', 'dc064e02-e4fe-4990-85cb-ade625989e0f', '4defcd37-84eb-4357-8dea-b15f244debef'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:10 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:10 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "cinder-22f5b023-2fe0-4b40-9025-55410a01de6d-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Lock "cinder-22f5b023-2fe0-4b40-9025-55410a01de6d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "cinder-quobyte-22f5b023-2fe0-4b40-9025-55410a01de6d" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Lock "cinder-quobyte-22f5b023-2fe0-4b40-9025-55410a01de6d" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b376e6-3474-4602-9ee5-aac116404263]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:11 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d Apr 27 23:56:11 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:11 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.441s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:11 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Deleted volume successfully. Apr 27 23:56:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-29bc7fc9-b90c-4ecb-8f8c-b0f26ba08892 tempest-ServersNegativeTestJSON-37380410 None] Lock "cinder-59dceeab-0798-4a0f-b9ad-209dcc097f34-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:12 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d" returned: 0 in 1.218s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:12 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d Apr 27 23:56:12 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:13 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-22f5b023-2fe0-4b40-9025-55410a01de6d" returned: 0 in 1.371s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Lock "cinder-quobyte-22f5b023-2fe0-4b40-9025-55410a01de6d" released by "delete_volume" :: held 2.716s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Created reservations ['300955da-8960-49c7-a7b6-f540457e0c92', '799c185d-8ac5-426b-bb04-9c45b482d324', '7b05a160-00c3-42b6-9955-415561c24a3e', 'b8d80d39-e94c-41f9-85f5-92af5e04e8cf'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:13 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.c90fb634-ea24-46e9-aed3-294563957ba1fh1ryim2.img" returned: 0 in 5.123s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e44940f-a93d-4901-a6c7-25394a8e5158]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:13 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:13 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:13 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 Apr 27 23:56:13 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:14 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:14 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:14 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Deleted volume successfully. Apr 27 23:56:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-64a28080-b52e-4fb5-968d-0b96e02ae0b4 tempest-ServersNegativeTestJSON-37380410 None] Lock "cinder-22f5b023-2fe0-4b40-9025-55410a01de6d-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:14 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" returned: 0 in 0.690s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:14 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.c90fb634-ea24-46e9-aed3-294563957ba1fh1ryim2.img {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:56:14 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Converted 1024.00 MB image at 199.86 MB/s Apr 27 23:56:14 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] c90fb634-ea24-46e9-aed3-294563957ba1 was raw, no need to convert to raw {{(pid=81312) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 27 23:56:24 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:UPDATE=100,cinder:SELECT=79,cinder:INSERT=21,cinder:DELETE=12 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:56:24 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=79,cinder:UPDATE=111,cinder:INSERT=28,cinder:DELETE=6 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Flow 'volume_create_manager' (331846a0-fa4f-49e2-aa6a-ceac2e3ddcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616c4502-5a69-4509-ad6c-19bb55612a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616c4502-5a69-4509-ad6c-19bb55612a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-681588178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6f5779-4afc-4da1-8f13-1f59f1c57d22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8346943b31449c0a7a0cf2d2b01ed12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:30Z,use_quota=True,user_id='64d08ace09304affbc7519c8c96bb188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fe1cfa-a8c0-42be-829b-0f3d567d7b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fe1cfa-a8c0-42be-829b-0f3d567d7b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce420161-4532-427e-b147-476d528c17bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce420161-4532-427e-b147-476d528c17bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6f5779-4afc-4da1-8f13-1f59f1c57d22', 'volume_name': 'volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0723244d-68c5-46f0-bfe9-3f3c9aa9b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0723244d-68c5-46f0-bfe9-3f3c9aa9b073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6ef8a-87ac-4e1b-b888-51279fa66c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:30 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Volume 9f6f5779-4afc-4da1-8f13-1f59f1c57d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22', 'volume_size': 1} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.666s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Uploaded volume to glance image-id: c90fb634-ea24-46e9-aed3-294563957ba1. {{(pid=81312) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.898s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-369715890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6412ac0e-dc65-4fb3-9d48-57232d57ead9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74229bab075146eca4b39225c492df3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:09Z,use_quota=True,user_id='ac1323270629464e807c4f3b93caf456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Creating volume 6412ac0e-dc65-4fb3-9d48-57232d57ead9 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:30 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 2147483648 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:30 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 2147483648 Apr 27 23:56:30 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:30 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-27eb890c-4963-458b-84aa-4803805bcac1 tempest-VolumesActionsTest-1621829159 None] Copy volume to image completed successfully. Apr 27 23:56:31 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 2147483648" returned: 0 in 0.636s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:31 devstack sudo[87065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 Apr 27 23:56:31 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:31 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9" returned: 0 in 0.430s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-681588178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6f5779-4afc-4da1-8f13-1f59f1c57d22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8346943b31449c0a7a0cf2d2b01ed12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:30Z,use_quota=True,user_id='64d08ace09304affbc7519c8c96bb188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Creating volume 9f6f5779-4afc-4da1-8f13-1f59f1c57d22 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:31 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:31 devstack sudo[87068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 1073741824 Apr 27 23:56:31 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300b3f57-784c-4aae-805e-10b7f9f8702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9', 'volume_size': 2}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9010628c-d79a-4e59-8afb-7b95a3a3834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:31 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Volume volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 (6412ac0e-dc65-4fb3-9d48-57232d57ead9): created successfully Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9010628c-d79a-4e59-8afb-7b95a3a3834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Flow 'volume_create_manager' (6fd199cf-ebf2-41f3-a026-f1b59f2f3c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:31 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-208864a0-13f7-44dd-8972-824b20f9dde2 tempest-VolumesCloneNegativeTest-1025545743 None] Created volume successfully. Apr 27 23:56:32 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 1073741824" returned: 0 in 0.692s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Acquiring lock "cinder-6412ac0e-dc65-4fb3-9d48-57232d57ead9-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Lock "cinder-6412ac0e-dc65-4fb3-9d48-57232d57ead9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:32 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 Apr 27 23:56:32 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Acquiring lock "cinder-quobyte-6412ac0e-dc65-4fb3-9d48-57232d57ead9" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Lock "cinder-quobyte-6412ac0e-dc65-4fb3-9d48-57232d57ead9" acquired by "delete_volume" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:32 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[63257e3f-1459-4b81-94f5-69a1ba65324c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:32 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 Apr 27 23:56:32 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:33 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22" returned: 0 in 0.471s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.480s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d6ef8a-87ac-4e1b-b888-51279fa66c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c445e07-cc20-45fc-b7fc-33bc9e5acec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede005d8-5f67-4e48-b970-68482128132c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:33 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Volume volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 (9f6f5779-4afc-4da1-8f13-1f59f1c57d22): created successfully Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c445e07-cc20-45fc-b7fc-33bc9e5acec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Flow 'volume_create_manager' (331846a0-fa4f-49e2-aa6a-ceac2e3ddcd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:33 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6f3d4088-f53f-460b-a292-b04046836e6a tempest-VolumesTestJSON-485907853 None] Created volume successfully. Apr 27 23:56:33 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 Apr 27 23:56:33 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:33 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9" returned: 0 in 0.548s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:33 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9 Apr 27 23:56:33 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:33 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" returned: 0 in 0.552s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:33 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6412ac0e-dc65-4fb3-9d48-57232d57ead9" returned: 0 in 0.448s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa2e0dc-e57f-4d9a-a0ee-18373e7c1a5e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Lock "cinder-quobyte-6412ac0e-dc65-4fb3-9d48-57232d57ead9" released by "delete_volume" :: held 1.042s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Created reservations ['11787880-3471-4960-85f2-cce8cbcd877a', 'd12d0d09-bdbd-4251-8190-4a875244dfec', '58d92fd1-e69d-409c-b67b-0fb6d9612730', '78695ac3-55ef-4891-9dca-6f1a182d045f'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:33 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 Apr 27 23:56:33 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:33 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:33 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:34 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" returned: 0 in 0.565s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:34 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:34 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img Apr 27 23:56:34 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.468s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Deleted volume successfully. Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a81674a3-f01b-408a-9f17-605b148687bf tempest-VolumesCloneNegativeTest-1025545743 None] Lock "cinder-6412ac0e-dc65-4fb3-9d48-57232d57ead9-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Flow 'volume_create_manager' (b3cfba29-6618-43c4-a79a-05cde0fe7dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb14ef46-8e66-433c-9b98-e0b5999aa233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb14ef46-8e66-433c-9b98-e0b5999aa233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-122847345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9335be45-db20-430b-87c6-d4797321bd86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8346943b31449c0a7a0cf2d2b01ed12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:35Z,use_quota=True,user_id='64d08ace09304affbc7519c8c96bb188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37051cad-186f-4885-bb69-e80497a6aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37051cad-186f-4885-bb69-e80497a6aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82db02b7-aee8-4655-b6b0-e014d7e7b57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82db02b7-aee8-4655-b6b0-e014d7e7b57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9335be45-db20-430b-87c6-d4797321bd86', 'volume_name': 'volume-9335be45-db20-430b-87c6-d4797321bd86', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ce0e64-d741-49e5-8740-a865cfc65bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ce0e64-d741-49e5-8740-a865cfc65bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbd7e4e-3fa3-41b9-97e4-cc98e28ab89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:34 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Volume 9335be45-db20-430b-87c6-d4797321bd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9335be45-db20-430b-87c6-d4797321bd86', 'volume_size': 1} Apr 27 23:56:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:39 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img" returned: 0 in 5.094s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:39 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[684ec531-da3a-4e40-bb8c-73cbb4b60944]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:39 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 Apr 27 23:56:39 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (df9073e0-4db8-4c15-be33-e7d5fd55becb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fc1597-0333-4391-bd5e-0c484af61cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fc1597-0333-4391-bd5e-0c484af61cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1430836180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28686fb-b459-4682-b715-0f34d24cf306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:40Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1238c039-0e04-43e9-bdf4-30a73dd7ec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1238c039-0e04-43e9-bdf4-30a73dd7ec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac830ec-511e-400c-8b3a-989081ce7912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac830ec-511e-400c-8b3a-989081ce7912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c28686fb-b459-4682-b715-0f34d24cf306', 'volume_name': 'volume-c28686fb-b459-4682-b715-0f34d24cf306', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0986a960-6fa9-4dd6-8afa-0a6af2ee9bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0986a960-6fa9-4dd6-8afa-0a6af2ee9bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77171e9-11a0-4a9a-8326-3aed8b4865be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Volume c28686fb-b459-4682-b715-0f34d24cf306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c28686fb-b459-4682-b715-0f34d24cf306', 'volume_size': 1} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:40 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" returned: 0 in 0.693s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:56:40 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Converted 1024.00 MB image at 200.94 MB/s Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] df2233b4-0104-4b13-921d-b58a5d6a18b7 was raw, converting to qcow2 {{(pid=81312) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b480795-1791-4abe-b742-b9f16a04053e]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:40 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img Apr 27 23:56:40 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (8a3eb55c-be87-470d-94ab-4a3e96ce6394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3e9044-2cab-4392-98ed-aedf527afdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3e9044-2cab-4392-98ed-aedf527afdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1396064498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9280b4be-2193-42f9-9e9c-0ae7b6212cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:40Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadf935a-ba7c-415a-a108-bb40a55dbce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadf935a-ba7c-415a-a108-bb40a55dbce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dd3942-1b38-4dbe-93d3-3c78b00f3873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dd3942-1b38-4dbe-93d3-3c78b00f3873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9280b4be-2193-42f9-9e9c-0ae7b6212cb9', 'volume_name': 'volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c326d6-2fd3-49ed-8783-1f8360e18f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c326d6-2fd3-49ed-8783-1f8360e18f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138eca11-cdfb-405f-a70d-e7a7d0620221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Volume 9280b4be-2193-42f9-9e9c-0ae7b6212cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9', 'volume_size': 1} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (d226e961-4827-49d0-ab8b-d4df5d6365a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3de8b5a-6260-4317-8ada-a7f7e624a791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3de8b5a-6260-4317-8ada-a7f7e624a791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1920418442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c813066f-42fb-438f-baa3-4bd4c03c3e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:41Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51ba6e9-9044-460f-913a-d5b7891b92d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51ba6e9-9044-460f-913a-d5b7891b92d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7da6ae-2ab8-4509-9b47-a4940dfef488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7da6ae-2ab8-4509-9b47-a4940dfef488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c813066f-42fb-438f-baa3-4bd4c03c3e81', 'volume_name': 'volume-c813066f-42fb-438f-baa3-4bd4c03c3e81', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c91ef5-bfef-4798-b2a6-61736330f9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c91ef5-bfef-4798-b2a6-61736330f9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713bd538-dbf0-45ab-b193-b74b6359d916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Volume c813066f-42fb-438f-baa3-4bd4c03c3e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c813066f-42fb-438f-baa3-4bd4c03c3e81', 'volume_size': 1} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img" returned: 0 in 0.531s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:40 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img Apr 27 23:56:40 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (7c658dc4-8fbe-4889-934a-73f33d7cb951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704d51d2-5059-4c91-9fc2-d0954e16406c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704d51d2-5059-4c91-9fc2-d0954e16406c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1450837297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7b678c-db81-4168-83a7-b9b105a72b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:41Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575d5a1b-78a2-4c02-9de1-7faec5e6c246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575d5a1b-78a2-4c02-9de1-7faec5e6c246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e9421a-d0c1-45d9-9384-83cd5f848622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e9421a-d0c1-45d9-9384-83cd5f848622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be7b678c-db81-4168-83a7-b9b105a72b5c', 'volume_name': 'volume-be7b678c-db81-4168-83a7-b9b105a72b5c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd74b4d6-cc44-467f-9f19-94ca487d7bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd74b4d6-cc44-467f-9f19-94ca487d7bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c926af2f-1047-489f-8ce1-f1a89709a489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:40 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Volume be7b678c-db81-4168-83a7-b9b105a72b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be7b678c-db81-4168-83a7-b9b105a72b5c', 'volume_size': 1} Apr 27 23:56:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (7a0a92f7-1684-42f4-ba3b-84675332b845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:41 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd5c806-5ee1-488f-8e2d-30c498c1ef79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img" returned: 1 in 0.524s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img /opt/stack/data/cinder/conversion/vol_upload_bx6ywk8j {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:41 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img /opt/stack/data/cinder/conversion/vol_upload_bx6ywk8j Apr 27 23:56:41 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd5c806-5ee1-488f-8e2d-30c498c1ef79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208223822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7b4c8d-22e7-4d84-84d3-d5a32550bf08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:41Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35121bb-abfb-440b-8343-5a9ff3c905d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35121bb-abfb-440b-8343-5a9ff3c905d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9717c1-d5e1-4dbb-af87-fe6e0991de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9717c1-d5e1-4dbb-af87-fe6e0991de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7b4c8d-22e7-4d84-84d3-d5a32550bf08', 'volume_name': 'volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b1bf5b-5e54-41b1-b138-80c1995359dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b1bf5b-5e54-41b1-b138-80c1995359dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1471f236-4540-4c88-9071-5a5d34ea5536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:41 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Volume ff7b4c8d-22e7-4d84-84d3-d5a32550bf08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08', 'volume_size': 1} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:41 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img /opt/stack/data/cinder/conversion/vol_upload_bx6ywk8j" returned: 0 in 0.428s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Image conversion details: src /opt/stack/data/cinder/conversion/9d38485b-b4fd-44b1-9acc-292b7cf0f3d0.temp_image.df2233b4-0104-4b13-921d-b58a5d6a18b71pwjs39m.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_bx6ywk8j {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:56:41 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eccd73-3bb2-4641-9050-d68962c2e710]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bx6ywk8j {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:41 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bx6ywk8j Apr 27 23:56:41 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:42 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bx6ywk8j" returned: 0 in 0.487s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.368s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Uploaded volume to glance image-id: df2233b4-0104-4b13-921d-b58a5d6a18b7. {{(pid=81312) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.636s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-122847345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9335be45-db20-430b-87c6-d4797321bd86,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8346943b31449c0a7a0cf2d2b01ed12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:35Z,use_quota=True,user_id='64d08ace09304affbc7519c8c96bb188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Creating volume 9335be45-db20-430b-87c6-d4797321bd86 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:43 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:43 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86 1073741824 Apr 27 23:56:43 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:43 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-89aa5530-2fcf-44a1-a2f3-fd07fb658b46 tempest-VolumesActionsTest-1621829159 None] Copy volume to image completed successfully. Apr 27 23:56:44 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86 1073741824" returned: 0 in 0.634s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:44 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86 Apr 27 23:56:44 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Acquiring lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:44 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86" returned: 0 in 0.473s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.547s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1430836180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28686fb-b459-4682-b715-0f34d24cf306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:40Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Creating volume c28686fb-b459-4682-b715-0f34d24cf306 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:44 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:44 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306 1073741824 Apr 27 23:56:44 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbd7e4e-3fa3-41b9-97e4-cc98e28ab89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9335be45-db20-430b-87c6-d4797321bd86', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499adefa-7cd7-4a99-8b81-5189d002bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Acquiring lock "cinder-quobyte-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:44 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Volume volume-9335be45-db20-430b-87c6-d4797321bd86 (9335be45-db20-430b-87c6-d4797321bd86): created successfully Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499adefa-7cd7-4a99-8b81-5189d002bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Flow 'volume_create_manager' (b3cfba29-6618-43c4-a79a-05cde0fe7dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Lock "cinder-quobyte-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" acquired by "delete_volume" :: waited 0.034s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:44 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-afa69ab8-e06b-49ca-98c2-3f50de00a0f6 tempest-VolumesTestJSON-485907853 None] Created volume successfully. Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[124fc34c-7b1e-44ec-a5bf-5fa736e999b9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:44 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 Apr 27 23:56:44 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:45 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:45 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:45 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306 1073741824" returned: 0 in 0.617s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:45 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" returned: 0 in 0.550s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:45 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0 Apr 27 23:56:45 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:45 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306 Apr 27 23:56:45 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:45 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.479s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:45 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:45 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306" returned: 0 in 0.482s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.385s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1396064498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9280b4be-2193-42f9-9e9c-0ae7b6212cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:40Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Creating volume 9280b4be-2193-42f9-9e9c-0ae7b6212cb9 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:45 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" returned: 0 in 0.537s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:45 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 1073741824 Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Lock "cinder-quobyte-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0" released by "delete_volume" :: held 1.135s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:45 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77171e9-11a0-4a9a-8326-3aed8b4865be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28686fb-b459-4682-b715-0f34d24cf306', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42a786a-2ba7-4bf1-81d2-fecd19df5fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:45 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Volume volume-c28686fb-b459-4682-b715-0f34d24cf306 (c28686fb-b459-4682-b715-0f34d24cf306): created successfully Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42a786a-2ba7-4bf1-81d2-fecd19df5fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (df9073e0-4db8-4c15-be33-e7d5fd55becb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:45 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7a2e7fbd-da0e-48f0-ac3b-97a005f46f3b tempest-CreateVolumesFromImageTest-1566478553 None] Created volume successfully. Apr 27 23:56:45 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Created reservations ['4a4ec01e-82fc-4c8d-a5ad-c7d53ac368fe', '5cdf3f70-cd1e-4664-b129-55a1451e0ffc', '8d572344-6ede-44ad-9fda-edaa77a5d203', 'accae000-2007-45cb-a57e-26e850b34fd6'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:46 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:46 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Flow 'volume_create_manager' (80b49871-c5cd-4440-a894-12dbc61b85f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e536bb1-7185-4941-bfc7-d5f257cd4aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e536bb1-7185-4941-bfc7-d5f257cd4aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-17249348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a9106d-e9d5-43b1-ad2e-823e0535ca03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8346943b31449c0a7a0cf2d2b01ed12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:46Z,use_quota=True,user_id='64d08ace09304affbc7519c8c96bb188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edbe6ac-c25c-4acf-8205-93f94d53ee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edbe6ac-c25c-4acf-8205-93f94d53ee4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47034f04-812c-4c33-b61e-adc2e4e48127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47034f04-812c-4c33-b61e-adc2e4e48127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a9106d-e9d5-43b1-ad2e-823e0535ca03', 'volume_name': 'volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1368e91-d6ef-46d1-ba85-0eedad16426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1368e91-d6ef-46d1-ba85-0eedad16426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d116c7eb-b7f8-4229-93a4-56a1e6e5eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:46 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Volume 81a9106d-e9d5-43b1-ad2e-823e0535ca03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03', 'volume_size': 1} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:46 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.526s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:46 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Deleted volume successfully. Apr 27 23:56:46 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 1073741824" returned: 0 in 0.758s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-66f2ba0d-21eb-4871-a3b7-ddee7af784aa tempest-VolumesActionsTest-1621829159 None] Lock "cinder-9d38485b-b4fd-44b1-9acc-292b7cf0f3d0-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:46 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 Apr 27 23:56:46 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:47 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9" returned: 0 in 0.459s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.414s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1920418442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c813066f-42fb-438f-baa3-4bd4c03c3e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:41Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Creating volume c813066f-42fb-438f-baa3-4bd4c03c3e81 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:47 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:47 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 1073741824 Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138eca11-cdfb-405f-a70d-e7a7d0620221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:47 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbac08f-5ef3-4918-b358-7e94fc30e1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:47 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Volume volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 (9280b4be-2193-42f9-9e9c-0ae7b6212cb9): created successfully Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbac08f-5ef3-4918-b358-7e94fc30e1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (8a3eb55c-be87-470d-94ab-4a3e96ce6394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:47 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1703cf07-8802-44cb-9976-5882d3c5f103 tempest-CreateVolumesFromImageTest-1566478553 None] Created volume successfully. Apr 27 23:56:47 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 1073741824" returned: 0 in 0.664s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:47 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 Apr 27 23:56:47 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:48 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81" returned: 0 in 0.493s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.296s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1450837297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7b678c-db81-4168-83a7-b9b105a72b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:41Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Creating volume be7b678c-db81-4168-83a7-b9b105a72b5c {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:48 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713bd538-dbf0-45ab-b193-b74b6359d916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c813066f-42fb-438f-baa3-4bd4c03c3e81', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:48 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c 1073741824 Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7ba0ce-9d06-4134-9b9c-06b9d6b81767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:48 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:48 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Volume volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 (c813066f-42fb-438f-baa3-4bd4c03c3e81): created successfully Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7ba0ce-9d06-4134-9b9c-06b9d6b81767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (d226e961-4827-49d0-ab8b-d4df5d6365a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:48 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e8c67f13-c3a1-4104-b8dd-9d3250ee3876 tempest-CreateVolumesFromImageTest-1566478553 None] Created volume successfully. Apr 27 23:56:48 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c 1073741824" returned: 0 in 0.701s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:49 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c Apr 27 23:56:49 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:49 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c" returned: 0 in 0.480s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.253s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208223822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7b4c8d-22e7-4d84-84d3-d5a32550bf08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8208f92ff37f41bf9ac3cfb1d9b2d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:41Z,use_quota=True,user_id='e2bdd1edc8ef417f90878ab042c63682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Creating volume ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:49 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c926af2f-1047-489f-8ce1-f1a89709a489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be7b678c-db81-4168-83a7-b9b105a72b5c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d7593e-0564-4a05-8a21-b3b7759f4cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:49 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 1073741824 Apr 27 23:56:49 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:49 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Volume volume-be7b678c-db81-4168-83a7-b9b105a72b5c (be7b678c-db81-4168-83a7-b9b105a72b5c): created successfully Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d7593e-0564-4a05-8a21-b3b7759f4cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (7c658dc4-8fbe-4889-934a-73f33d7cb951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:49 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0ef35460-faf6-4626-9381-37ea3df07a9c tempest-CreateVolumesFromImageTest-1566478553 None] Created volume successfully. Apr 27 23:56:50 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 1073741824" returned: 0 in 0.772s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:50 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 Apr 27 23:56:50 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:50 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08" returned: 0 in 0.488s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.646s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-17249348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a9106d-e9d5-43b1-ad2e-823e0535ca03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b8346943b31449c0a7a0cf2d2b01ed12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:46Z,use_quota=True,user_id='64d08ace09304affbc7519c8c96bb188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Creating volume 81a9106d-e9d5-43b1-ad2e-823e0535ca03 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:50 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:50 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 1073741824 Apr 27 23:56:50 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1471f236-4540-4c88-9071-5a5d34ea5536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07aec066-7e1b-4f7b-b967-deb0761defdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:50 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Volume volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 (ff7b4c8d-22e7-4d84-84d3-d5a32550bf08): created successfully Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07aec066-7e1b-4f7b-b967-deb0761defdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:50 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Flow 'volume_create_manager' (7a0a92f7-1684-42f4-ba3b-84675332b845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:50 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-affd0b37-a6a2-4d5b-ba3d-176e695071e3 tempest-CreateVolumesFromImageTest-1566478553 None] Created volume successfully. Apr 27 23:56:51 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 1073741824" returned: 0 in 0.716s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:51 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 Apr 27 23:56:51 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:52 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03" returned: 0 in 0.497s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d116c7eb-b7f8-4229-93a4-56a1e6e5eb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ded3c5-cccc-4465-8a2a-2d44ca9f7fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:52 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Volume volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 (81a9106d-e9d5-43b1-ad2e-823e0535ca03): created successfully Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ded3c5-cccc-4465-8a2a-2d44ca9f7fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Flow 'volume_create_manager' (80b49871-c5cd-4440-a894-12dbc61b85f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:52 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-40120ad6-c573-4df4-88b3-cf63122efd5e tempest-VolumesTestJSON-485907853 None] Created volume successfully. Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-quobyte-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedb4e45-ff4b-4f02-808b-3953bf3acc01]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Flow 'volume_create_manager' (b25099f0-2b80-4e33-9faf-78e003431684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765daf40-2034-4355-a74a-dfdea081dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765daf40-2034-4355-a74a-dfdea081dabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-355690308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fa1140-a6b9-450b-9b94-8693918ea977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c768daf0e2462cbd3f0b1c2332a3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:52Z,use_quota=True,user_id='fe0325a87b5f48c5bc007846bb410b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43190667-e02e-4b28-80bb-ceff7f0789e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:52 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 Apr 27 23:56:52 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43190667-e02e-4b28-80bb-ceff7f0789e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45e1b93-3f1f-4fee-b683-20153016927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45e1b93-3f1f-4fee-b683-20153016927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fa1140-a6b9-450b-9b94-8693918ea977', 'volume_name': 'volume-69fa1140-a6b9-450b-9b94-8693918ea977', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b269fb39-5bb0-4ccc-bb72-ea1a4863a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b269fb39-5bb0-4ccc-bb72-ea1a4863a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51126915-c737-4117-903d-35a02d2d8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:52 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Volume 69fa1140-a6b9-450b-9b94-8693918ea977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fa1140-a6b9-450b-9b94-8693918ea977', 'volume_size': 1} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-355690308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fa1140-a6b9-450b-9b94-8693918ea977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c768daf0e2462cbd3f0b1c2332a3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:52Z,use_quota=True,user_id='fe0325a87b5f48c5bc007846bb410b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Creating volume 69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:56:52 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:52 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 1073741824 Apr 27 23:56:52 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:52 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08" returned: 0 in 0.597s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:52 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08 Apr 27 23:56:52 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:53 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 1073741824" returned: 0 in 0.691s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:53 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 Apr 27 23:56:53 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Acquiring lock "cinder-81a9106d-e9d5-43b1-ad2e-823e0535ca03-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Lock "cinder-81a9106d-e9d5-43b1-ad2e-823e0535ca03-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Acquiring lock "cinder-quobyte-81a9106d-e9d5-43b1-ad2e-823e0535ca03" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Lock "cinder-quobyte-81a9106d-e9d5-43b1-ad2e-823e0535ca03" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:53 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08" returned: 0 in 0.540s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4319920-2ef3-4bbc-9c40-ce925a33db3c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08" released by "delete_volume" :: held 1.191s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Created reservations ['c9a71ee5-34d4-4600-8db5-19a5ae6f8f87', '26df7650-81d6-4f21-a811-ca1816b8b720', '6bc385af-ea10-454e-86f6-793c7bbc9ba4', '8abe3a25-9724-4e6b-95ec-fced7500e5a5'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:53 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 Apr 27 23:56:53 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:53 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:53 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:53 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977" returned: 0 in 0.507s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51126915-c737-4117-903d-35a02d2d8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fa1140-a6b9-450b-9b94-8693918ea977', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c55dd84-9eb3-4067-9e70-a25491176a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:53 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Volume volume-69fa1140-a6b9-450b-9b94-8693918ea977 (69fa1140-a6b9-450b-9b94-8693918ea977): created successfully Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c55dd84-9eb3-4067-9e70-a25491176a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Flow 'volume_create_manager' (b25099f0-2b80-4e33-9faf-78e003431684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-83daddad-a50f-43fc-a574-0ef011c0ba1a tempest-VolumesCloneTest-2130222151 None] Created volume successfully. Apr 27 23:56:53 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03" returned: 0 in 0.548s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:53 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03 Apr 27 23:56:53 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:54 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.458s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:54 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Deleted volume successfully. Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-fbe77909-357b-429d-a17e-7262ffeb62ff tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-ff7b4c8d-22e7-4d84-84d3-d5a32550bf08-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-be7b678c-db81-4168-83a7-b9b105a72b5c-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-be7b678c-db81-4168-83a7-b9b105a72b5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-quobyte-be7b678c-db81-4168-83a7-b9b105a72b5c" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-be7b678c-db81-4168-83a7-b9b105a72b5c" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[758feae0-44dc-47d7-a4bd-ec337457f151]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:54 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-81a9106d-e9d5-43b1-ad2e-823e0535ca03" returned: 0 in 0.519s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Lock "cinder-quobyte-81a9106d-e9d5-43b1-ad2e-823e0535ca03" released by "delete_volume" :: held 1.114s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:54 devstack sudo[87268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c Apr 27 23:56:54 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Created reservations ['881596f9-d677-48b2-9621-0374408ce1c5', 'ac436ac0-eb11-4723-bf73-bc9e942a33eb', '7ddbf7f6-1619-4b69-ba8a-70126343aa93', '9e5128cb-87bf-45cf-bf1c-d497b59b07a6'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:54 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:54 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Flow 'volume_create_manager' (0b80846c-6a12-4bd6-8f19-cf25346a992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a686009-813e-4ed0-b30c-d9e62cd41096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a686009-813e-4ed0-b30c-d9e62cd41096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-364216672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fe065b-22a4-4989-b1f8-3e536ce9409f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c768daf0e2462cbd3f0b1c2332a3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:56:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=69fa1140-a6b9-450b-9b94-8693918ea977,status='creating',terminated_at=None,updated_at=2026-04-27T21:56:55Z,use_quota=True,user_id='fe0325a87b5f48c5bc007846bb410b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111b0cbc-c0b6-4055-af7f-2655b8bf984d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111b0cbc-c0b6-4055-af7f-2655b8bf984d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57ae79d-a15e-4d5c-9095-174f02b26878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57ae79d-a15e-4d5c-9095-174f02b26878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f9fe065b-22a4-4989-b1f8-3e536ce9409f', 'volume_name': 'volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f', 'volume_size': 2, 'source_volid': '69fa1140-a6b9-450b-9b94-8693918ea977', 'source_volstatus': 'available'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a5df3e-97b3-4c21-9eed-ebb3cc89477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a5df3e-97b3-4c21-9eed-ebb3cc89477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c564130-85e6-4f77-baa3-9224d695c1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:56:54 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Volume f9fe065b-22a4-4989-b1f8-3e536ce9409f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f', 'volume_size': 2, 'source_volid': '69fa1140-a6b9-450b-9b94-8693918ea977', 'source_volstatus': 'available'} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:54 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Cloning volume 69fa1140-a6b9-450b-9b94-8693918ea977 to volume f9fe065b-22a4-4989-b1f8-3e536ce9409f Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Creating offline snapshot 6e6f0c9a-6b20-4220-974d-a75f7c4f5bab of volume 69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[696dbf0d-7415-4450-887a-4ad4a4891cc9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:55 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 Apr 27 23:56:55 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:55 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c" returned: 0 in 0.623s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:55 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.473s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:55 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c Apr 27 23:56:55 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:55 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Deleted volume successfully. Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f3312b55-35a1-410e-93e2-d274051524aa tempest-VolumesTestJSON-485907853 None] Lock "cinder-81a9106d-e9d5-43b1-ad2e-823e0535ca03-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:55 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-be7b678c-db81-4168-83a7-b9b105a72b5c" returned: 0 in 0.448s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:55 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977" returned: 0 in 0.547s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-be7b678c-db81-4168-83a7-b9b105a72b5c" released by "delete_volume" :: held 1.119s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:55 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab 1G Apr 27 23:56:55 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Acquiring lock "cinder-9335be45-db20-430b-87c6-d4797321bd86-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Created reservations ['e1f1d5d2-6316-4aae-abe4-46fffa453445', '262203fc-52fe-422f-b153-23cee603934f', '982a7f1b-b303-4ddb-8139-e9ca1c127bb1', 'f318f570-7fec-4b01-843c-0a4724cf8ccb'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Lock "cinder-9335be45-db20-430b-87c6-d4797321bd86-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Acquiring lock "cinder-quobyte-9335be45-db20-430b-87c6-d4797321bd86" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:55 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:55 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Lock "cinder-quobyte-9335be45-db20-430b-87c6-d4797321bd86" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca723b-6f74-44af-8d92-9edc9ae9ccfc]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:55 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86 Apr 27 23:56:55 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:56 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab 1G" returned: 0 in 0.644s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69fa1140-a6b9-450b-9b94-8693918ea977 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:56 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.496s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:56 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Deleted volume successfully. Apr 27 23:56:56 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69fa1140-a6b9-450b-9b94-8693918ea977 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab Apr 27 23:56:56 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8767c3ec-0a87-48f9-be87-ec80dc367b8a tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-be7b678c-db81-4168-83a7-b9b105a72b5c-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:56 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86" returned: 0 in 0.570s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:56 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86 Apr 27 23:56:56 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-c813066f-42fb-438f-baa3-4bd4c03c3e81-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-c813066f-42fb-438f-baa3-4bd4c03c3e81-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-quobyte-c813066f-42fb-438f-baa3-4bd4c03c3e81" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-c813066f-42fb-438f-baa3-4bd4c03c3e81" acquired by "delete_volume" :: waited 0.033s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c58193a-c1c0-4ea5-abef-7fcd93c84da1]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:56 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69fa1140-a6b9-450b-9b94-8693918ea977 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab" returned: 0 in 0.551s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:56 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab is being set with open permissions: ugo+rw Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:56 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab Apr 27 23:56:56 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:56 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 Apr 27 23:56:56 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:56 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9335be45-db20-430b-87c6-d4797321bd86" returned: 0 in 0.477s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Lock "cinder-quobyte-9335be45-db20-430b-87c6-d4797321bd86" released by "delete_volume" :: held 1.086s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Created reservations ['437aaf6e-35bc-40ca-9982-1f7b9e0fc52e', 'd3d9746a-cb7d-473a-9d7c-03fd39480ea0', '6fbdcb59-08ad-4993-a514-bf7e40739ba1', '51accf98-c818-467c-9c23-8680d9defd1a'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:56 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:56 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:57 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab" returned: 0 in 0.443s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:57 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.info Apr 27 23:56:57 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:57 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81" returned: 0 in 0.609s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:57 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81 Apr 27 23:56:57 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:57 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.446s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:57 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Deleted volume successfully. Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-60b3b85f-9d19-4b3a-85f4-61476e295a19 tempest-VolumesTestJSON-485907853 None] Lock "cinder-9335be45-db20-430b-87c6-d4797321bd86-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:57 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.info" returned: 0 in 0.466s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:57 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.info is being set with open permissions: ugo+rw Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:57 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.info Apr 27 23:56:57 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:57 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c813066f-42fb-438f-baa3-4bd4c03c3e81" returned: 0 in 0.437s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-c813066f-42fb-438f-baa3-4bd4c03c3e81" released by "delete_volume" :: held 1.088s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Created reservations ['ee542f66-e968-4662-a9f0-ad4997daace9', '69833d02-ef21-4ecd-8b6e-62e77d5fef97', '2254602b-42eb-4b5c-8f8b-d32cf9d459b6', '3615fde0-5815-492f-ac2a-ac065330962d'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Acquiring lock "cinder-9f6f5779-4afc-4da1-8f13-1f59f1c57d22-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Lock "cinder-9f6f5779-4afc-4da1-8f13-1f59f1c57d22-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:57 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:57 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Acquiring lock "cinder-quobyte-9f6f5779-4afc-4da1-8f13-1f59f1c57d22" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Lock "cinder-quobyte-9f6f5779-4afc-4da1-8f13-1f59f1c57d22" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0bbe33-d9b1-4315-b3d0-a59d81aa4c44]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:58 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 Apr 27 23:56:58 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:58 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.info" returned: 0 in 0.463s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Acquiring lock "cinder-quobyte-f9fe065b-22a4-4989-b1f8-3e536ce9409f" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Lock "cinder-quobyte-f9fe065b-22a4-4989-b1f8-3e536ce9409f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] snapshot: 6e6f0c9a-6b20-4220-974d-a75f7c4f5bab, volume: f9fe065b-22a4-4989-b1f8-3e536ce9409f, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a398c23b-5ea8-4e66-a454-d65bb968069a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:58 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab Apr 27 23:56:58 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:58 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.490s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Deleted volume successfully. Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cc140bac-243f-4874-ae1b-32eac41eb7da tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-c813066f-42fb-438f-baa3-4bd4c03c3e81-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:58 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:58 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22 Apr 27 23:56:58 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:58 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab" returned: 0 in 0.562s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69fa1140-a6b9-450b-9b94-8693918ea977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4e5496-415b-4131-9880-1726e818ab30]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-9280b4be-2193-42f9-9e9c-0ae7b6212cb9-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:58 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 Apr 27 23:56:58 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-9280b4be-2193-42f9-9e9c-0ae7b6212cb9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-quobyte-9280b4be-2193-42f9-9e9c-0ae7b6212cb9" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-9280b4be-2193-42f9-9e9c-0ae7b6212cb9" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a75d93e-3054-47eb-a60e-3231229c270f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:56:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:59 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9f6f5779-4afc-4da1-8f13-1f59f1c57d22" returned: 0 in 0.532s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Lock "cinder-quobyte-9f6f5779-4afc-4da1-8f13-1f59f1c57d22" released by "delete_volume" :: held 1.092s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:59 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 Apr 27 23:56:59 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Created reservations ['9ebb96f1-eead-4573-a75a-3fa32651736f', '1df440a2-150b-48da-a0fc-2d529160dedc', '543da7a8-be56-4277-a336-cde0436aacac', 'e5796eae-dd7b-460d-a7c8-39c999d1966c'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:59 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:56:59 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:59 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977" returned: 0 in 0.607s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:59 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f Apr 27 23:56:59 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:59 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9" returned: 0 in 0.543s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:56:59 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9 Apr 27 23:56:59 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:56:59 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.457s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:56:59 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Deleted volume successfully. Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-939df478-70de-4eea-8e91-4ed5b1b6f5f0 tempest-VolumesTestJSON-485907853 None] Lock "cinder-9f6f5779-4afc-4da1-8f13-1f59f1c57d22-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:56:59 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 27 23:56:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9280b4be-2193-42f9-9e9c-0ae7b6212cb9" returned: 0 in 0.492s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:00 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-9280b4be-2193-42f9-9e9c-0ae7b6212cb9" released by "delete_volume" :: held 1.084s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:00 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Created reservations ['aba8f2e0-a7f4-4f00-83ae-be046239bd66', '0c406112-8c35-4062-9717-67e0fc0224cd', '9a99d283-6435-4ded-b715-92d93868e98f', '82855a2a-fd72-4b64-b060-ef519bc5eeb4'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:00 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:00 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-c28686fb-b459-4682-b715-0f34d24cf306-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-c28686fb-b459-4682-b715-0f34d24cf306-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "cinder-quobyte-c28686fb-b459-4682-b715-0f34d24cf306" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-c28686fb-b459-4682-b715-0f34d24cf306" acquired by "delete_volume" :: waited 0.046s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:01 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b09f7d3-99eb-4894-b9f6-a808906a8d35]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:01 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.392s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:01 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:01 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Deleted volume successfully. Apr 27 23:57:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2ee0a129-62ec-4ea7-89c1-c08ce3c922af tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-9280b4be-2193-42f9-9e9c-0ae7b6212cb9-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:01 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306 Apr 27 23:57:01 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:02 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306" returned: 0 in 1.414s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:02 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306 Apr 27 23:57:02 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:03 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c28686fb-b459-4682-b715-0f34d24cf306" returned: 0 in 1.032s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-quobyte-c28686fb-b459-4682-b715-0f34d24cf306" released by "delete_volume" :: held 2.520s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:04 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Created reservations ['34fd1a8e-3bea-4210-8a37-08671b0132bc', '38173841-d7b9-4e94-a654-310a16db56b3', '8eda9a66-2578-435d-87c5-a9b11b5d5eec', '5712ea3d-4a4e-4da3-bb56-633d03f0b506'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:04 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:04 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:05 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:05 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.058s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:05 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f" returned: 0 in 5.955s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:05 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Deleted volume successfully. Apr 27 23:57:05 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c164607d-5164-4c56-bfd1-e422ed3c584f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-28db7b93-cbf6-431c-8888-aa57f6cf407f tempest-CreateVolumesFromImageTest-1566478553 None] Lock "cinder-c28686fb-b459-4682-b715-0f34d24cf306-delete_volume" released by "delete_volume" :: held 4.014s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:05 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 Apr 27 23:57:05 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:06 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977" returned: 0 in 0.861s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:57:06 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Converted 1024.00 MB image at 171.91 MB/s Apr 27 23:57:06 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f is being set with open permissions: ugo+rw Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:06 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f Apr 27 23:57:06 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-dd1eedb2-a498-4a08-82d2-18e81a52b46b tempest-GroupSnapshotsTest-707872509 None] Group tempest-GroupSnapshotsTest-Group-874022045: creating Apr 27 23:57:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-dd1eedb2-a498-4a08-82d2-18e81a52b46b tempest-GroupSnapshotsTest-707872509 None] Group tempest-GroupSnapshotsTest-Group-874022045: created successfully Apr 27 23:57:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-dd1eedb2-a498-4a08-82d2-18e81a52b46b tempest-GroupSnapshotsTest-707872509 None] Create group completed successfully. Apr 27 23:57:06 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f" returned: 0 in 0.528s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Lock "cinder-quobyte-f9fe065b-22a4-4989-b1f8-3e536ce9409f" released by "_copy_volume_from_snapshot" :: held 8.599s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Acquiring lock "cinder-quobyte-6e6f0c9a-6b20-4220-974d-a75f7c4f5bab" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Lock "cinder-quobyte-6e6f0c9a-6b20-4220-974d-a75f7c4f5bab" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Deleting offline snapshot 6e6f0c9a-6b20-4220-974d-a75f7c4f5bab of volume 69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] snapshot_file for this snap is: volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8bd6ee-bab9-4b6c-9856-8e91639a441d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:06 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab Apr 27 23:57:06 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:07 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab" returned: 0 in 0.579s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69fa1140-a6b9-450b-9b94-8693918ea977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:57:07 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df86785-e013-4c8a-8248-4052390b9eea]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:07 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 Apr 27 23:57:07 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:07 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:08 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab Apr 27 23:57:08 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Flow 'volume_create_manager' (9d279156-830e-4e96-8b36-930eaafb75f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d53af3-0b4a-41a0-8e82-446d0f799192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d53af3-0b4a-41a0-8e82-446d0f799192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1906636950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98a37cfd-717a-423b-82ae-9725cfe9e13c,host='devstack@QuobyteHD#QuobyteHD',id=b7c1b0a7-6cd5-4e0e-a690-abbecada7183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2ede8372d4c20b06a604f3089d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:08Z,use_quota=True,user_id='ed6f9b3d4af041e3bde6e7a847cc3a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81c13646-da93-46fd-a012-d92ce544cc79),volume_type_id=81c13646-da93-46fd-a012-d92ce544cc79)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b963c4ed-6597-4047-a476-9d14146aa99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b963c4ed-6597-4047-a476-9d14146aa99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d159bb45-22e2-4d6e-92b5-c879e49569c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d159bb45-22e2-4d6e-92b5-c879e49569c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c1b0a7-6cd5-4e0e-a690-abbecada7183', 'volume_name': 'volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f0f63a-1b25-40c8-9279-f6b779396a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f0f63a-1b25-40c8-9279-f6b779396a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77091b1-6656-494d-8259-24d091cf7e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:08 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Volume b7c1b0a7-6cd5-4e0e-a690-abbecada7183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183', 'volume_size': 1} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:08 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab" returned: 0 in 0.544s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:08 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab Apr 27 23:57:08 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:08 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977.6e6f0c9a-6b20-4220-974d-a75f7c4f5bab" returned: 0 in 0.442s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Lock "cinder-quobyte-6e6f0c9a-6b20-4220-974d-a75f7c4f5bab" released by "_delete_snapshot" :: held 2.212s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.112s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=98a37cfd-717a-423b-82ae-9725cfe9e13c,created_at=2026-04-27T21:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1906636950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98a37cfd-717a-423b-82ae-9725cfe9e13c,host='devstack@QuobyteHD#QuobyteHD',id=b7c1b0a7-6cd5-4e0e-a690-abbecada7183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2ede8372d4c20b06a604f3089d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:08Z,use_quota=True,user_id='ed6f9b3d4af041e3bde6e7a847cc3a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81c13646-da93-46fd-a012-d92ce544cc79),volume_type_id=81c13646-da93-46fd-a012-d92ce544cc79)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Creating volume b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:57:09 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c564130-85e6-4f77-baa3-9224d695c1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f', 'volume_size': 2, 'source_volid': '69fa1140-a6b9-450b-9b94-8693918ea977', 'source_volstatus': 'available'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:09 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 1073741824 Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215ab332-cdf8-40f0-923c-45d182ac503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:09 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:09 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Volume volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f (f9fe065b-22a4-4989-b1f8-3e536ce9409f): created successfully Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215ab332-cdf8-40f0-923c-45d182ac503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Flow 'volume_create_manager' (0b80846c-6a12-4bd6-8f19-cf25346a992a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:09 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d380d329-7804-45ea-ad5f-3b638354ec7e tempest-VolumesCloneTest-2130222151 None] Created volume successfully. Apr 27 23:57:09 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 1073741824" returned: 0 in 0.609s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:09 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 Apr 27 23:57:09 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:10 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77091b1-6656-494d-8259-24d091cf7e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5b548b-1b36-4a04-902c-a26da4ff2396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:10 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Volume volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 (b7c1b0a7-6cd5-4e0e-a690-abbecada7183): created successfully Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5b548b-1b36-4a04-902c-a26da4ff2396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Flow 'volume_create_manager' (9d279156-830e-4e96-8b36-930eaafb75f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:10 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-63268869-c6e5-4590-8573-f85c4763fe16 tempest-GroupSnapshotsTest-707872509 None] Created volume successfully. Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Acquiring lock "cinder-f9fe065b-22a4-4989-b1f8-3e536ce9409f-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Lock "cinder-f9fe065b-22a4-4989-b1f8-3e536ce9409f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Acquiring lock "cinder-quobyte-f9fe065b-22a4-4989-b1f8-3e536ce9409f" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Lock "cinder-quobyte-f9fe065b-22a4-4989-b1f8-3e536ce9409f" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[847f0b0b-4244-47ea-a3a6-0819bf1ddefc]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:10 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f Apr 27 23:57:10 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:10 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] GroupSnapshot a4e82940-8a65-46ff-93d9-0e74ef750247: creating. Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Group snapshot a4e82940-8a65-46ff-93d9-0e74ef750247: creating. {{(pid=81312) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Creating offline snapshot 78696d48-373b-44ee-945f-2ef67a7e0a95 of volume b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c4ace0-5188-465c-8a86-ecbd7d7500f3]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:10 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 Apr 27 23:57:10 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:10 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f" returned: 0 in 0.576s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:10 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f Apr 27 23:57:10 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:11 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" returned: 0 in 0.527s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:11 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 1G Apr 27 23:57:11 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:11 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f9fe065b-22a4-4989-b1f8-3e536ce9409f" returned: 0 in 0.464s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Lock "cinder-quobyte-f9fe065b-22a4-4989-b1f8-3e536ce9409f" released by "delete_volume" :: held 1.083s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Created reservations ['a00ff6ff-9d35-4cc2-8a81-fb8f3878a478', 'a39f103e-f3ef-452b-bf8b-0b1ff37cd011', '7ece4242-ba93-4316-b2cb-571a22b9fb7d', '9e139b32-920c-46b4-ae62-9dacb51a2b93'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:11 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:11 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:11 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 1G" returned: 0 in 0.648s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:11 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 Apr 27 23:57:11 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:11 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.480s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Deleted volume successfully. Apr 27 23:57:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-176c18d5-bb50-47b4-b949-817de9951a56 tempest-VolumesCloneTest-2130222151 None] Lock "cinder-f9fe065b-22a4-4989-b1f8-3e536ce9409f-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:12 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95" returned: 0 in 0.493s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:12 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:12 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 Apr 27 23:57:12 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Acquiring lock "cinder-69fa1140-a6b9-450b-9b94-8693918ea977-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Lock "cinder-69fa1140-a6b9-450b-9b94-8693918ea977-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Acquiring lock "cinder-quobyte-69fa1140-a6b9-450b-9b94-8693918ea977" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Lock "cinder-quobyte-69fa1140-a6b9-450b-9b94-8693918ea977" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a34cee-9447-4ee8-ae48-0e23448b25b6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:12 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 Apr 27 23:57:12 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:12 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95" returned: 0 in 0.483s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:12 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.info Apr 27 23:57:12 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:13 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977" returned: 0 in 0.578s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:13 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977 Apr 27 23:57:13 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:13 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.info" returned: 0 in 0.435s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:13 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:13 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.info Apr 27 23:57:13 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:13 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69fa1140-a6b9-450b-9b94-8693918ea977" returned: 0 in 0.470s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:13 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.info" returned: 0 in 0.438s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.106s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Lock "cinder-quobyte-69fa1140-a6b9-450b-9b94-8693918ea977" released by "delete_volume" :: held 1.129s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Created reservations ['d7001ab7-a3d2-4985-a570-65a0da63ae95', '2bd17550-525d-4602-804d-574c4e6f34b7', '056aa1a0-f7e6-4cd9-a984-96c7ea376ad8', '77b4bcda-eb95-4175-b339-5950bb82b583'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:13 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-30f9ceba-28ad-4cba-9d4c-2493f878d05e tempest-GroupSnapshotsTest-707872509 None] group_snapshot a4e82940-8a65-46ff-93d9-0e74ef750247: created successfully Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:13 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:13 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:14 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:14 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:14 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Deleted volume successfully. Apr 27 23:57:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-47e51e99-7822-4deb-8df3-f2ce7c557a0a tempest-VolumesCloneTest-2130222151 None] Lock "cinder-69fa1140-a6b9-450b-9b94-8693918ea977-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-78696d48-373b-44ee-945f-2ef67a7e0a95-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" by "_create_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-78696d48-373b-44ee-945f-2ef67a7e0a95-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Creating volume 73e4ad17-c8a9-4255-bf9b-c6a369b0368e from snapshot 78696d48-373b-44ee-945f-2ef67a7e0a95 {{(pid=81312) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] snapshot: 78696d48-373b-44ee-945f-2ef67a7e0a95, volume: 73e4ad17-c8a9-4255-bf9b-c6a369b0368e, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:16 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[968f93d0-56d3-466e-8bb7-e75292c23ca3]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:16 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 Apr 27 23:57:16 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:16 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95" returned: 0 in 0.572s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:57:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 23:57:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 23:57:16 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac92851-ee82-4457-93ee-d14e99830577]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:16 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 Apr 27 23:57:16 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:17 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" returned: 0 in 0.629s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:17 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e Apr 27 23:57:17 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Flow 'volume_create_manager' (dfecb5a8-e1df-447d-b6c4-83b470d24c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d7b230-d109-4b9c-be89-690aa0a2a6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d7b230-d109-4b9c-be89-690aa0a2a6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-570525972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92a3638-2d69-458b-81e5-2e1001367381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921a1e5e5fb44257972faf7104e3a33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:18Z,use_quota=True,user_id='0319d1292ed840109ed760dfe3cd6c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4721b4d7-8de1-48f3-aa9e-80a2c8bd8674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4721b4d7-8de1-48f3-aa9e-80a2c8bd8674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04743c15-836e-4cbb-b116-02f0d342821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:17 devstack cinder-volume[81312]: DEBUG cinder.image.glance [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Creating Keystone auth plugin from conf {{(pid=81312) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 27 23:57:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04743c15-836e-4cbb-b116-02f0d342821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a92a3638-2d69-458b-81e5-2e1001367381', 'volume_name': 'volume-a92a3638-2d69-458b-81e5-2e1001367381', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d0928f-887d-41f7-a3ec-489a0e80a39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d0928f-887d-41f7-a3ec-489a0e80a39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de0703-f9a6-4da5-96df-4865de834c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:18 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Volume a92a3638-2d69-458b-81e5-2e1001367381: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a92a3638-2d69-458b-81e5-2e1001367381', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 27 23:57:18 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Trying to clone a92a3638-2d69-458b-81e5-2e1001367381 from image 8f48a915-9605-48af-ab48-fa6fc721c0a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]). {{(pid=81312) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 27 23:57:18 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 27 23:57:18 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Image download 20.69 MB at 20.69 MB/s Apr 27 23:57:19 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee61bf2-18aa-46ac-a91b-29f88f1a0eef]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:19 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD Apr 27 23:57:19 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:20 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD" returned: 0 in 1.103s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:20 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Temporary image 8f48a915-9605-48af-ab48-fa6fc721c0a5 is fetched for user 0319d1292ed840109ed760dfe3cd6c72. {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 27 23:57:20 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6bdde7-2d3b-47f9-adab-dd5f5a5962e8]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:20 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD Apr 27 23:57:20 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:21 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD" returned: 0 in 1.514s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:22 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" returned: 0 in 5.100s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:22 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8026d458-8d7d-48c5-8723-1072aeac0d81]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:22 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 Apr 27 23:57:22 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:22 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" returned: 0 in 0.643s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:22 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:57:22 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Converted 1024.00 MB image at 200.73 MB/s Apr 27 23:57:22 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:57:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:23 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e Apr 27 23:57:23 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:23 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" returned: 0 in 0.466s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" released by "_copy_volume_from_snapshot" :: held 7.525s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-78696d48-373b-44ee-945f-2ef67a7e0a95-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" released by "_create_volume_from_snapshot" :: held 7.567s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.590s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-570525972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92a3638-2d69-458b-81e5-2e1001367381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921a1e5e5fb44257972faf7104e3a33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:18Z,use_quota=True,user_id='0319d1292ed840109ed760dfe3cd6c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Creating volume a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:57:23 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:57:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:23 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 1073741824 Apr 27 23:57:23 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:23 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-da7de807-e910-4fc4-9b7c-5749fa6b5851 tempest-GroupSnapshotsTest-707872509 None] Create group from source-snapshot-a4e82940-8a65-46ff-93d9-0e74ef750247 completed successfully. Apr 27 23:57:24 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 1073741824" returned: 0 in 0.617s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:24 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 Apr 27 23:57:24 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=107,cinder:UPDATE=132,cinder:DELETE=15,cinder:INSERT=28 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:UPDATE=150,cinder:SELECT=102,cinder:INSERT=37,cinder:DELETE=9 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" acquired by "delete_volume" :: waited 0.026s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b998c4-174c-49a9-9ade-927443bef6e9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:24 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e Apr 27 23:57:24 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:24 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381" returned: 0 in 0.468s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Attempting download of 8f48a915-9605-48af-ab48-fa6fc721c0a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}])) to volume a92a3638-2d69-458b-81e5-2e1001367381. {{(pid=81312) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34392c1-13d2-4723-85d9-30ebbbb6a596]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_fldvbupb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:24 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_fldvbupb Apr 27 23:57:24 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:25 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" returned: 0 in 0.521s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:25 devstack sudo[87536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e Apr 27 23:57:25 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:25 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_fldvbupb" returned: 0 in 0.494s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_fldvbupb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:25 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_fldvbupb Apr 27 23:57:25 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:25 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-73e4ad17-c8a9-4255-bf9b-c6a369b0368e" released by "delete_volume" :: held 1.032s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['e95dc0ca-3f11-4629-a922-b0a40eb5a406'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:25 devstack cinder-volume[81312]: WARNING cinder.quota [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1845485711 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1845485711, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:57:25 devstack cinder-volume[81312]: WARNING cinder.quota [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1845485711 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1845485711, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['f0dcd3a6-ec6e-4dfc-a865-d8187651d37e', 'bcc4f56a-d642-4a3b-ae96-9d8d6d7d8c41', '18be1299-eb7e-4317-9e27-9f0a4593e52e', 'fb07e809-3134-457f-9106-c646950cc37e'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:25 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_fldvbupb" returned: 1 in 0.565s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_fldvbupb' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb4bd70-e2c0-4058-8b24-aae47b9e776e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:25 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:25 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:25 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD Apr 27 23:57:25 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:26 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b4ab6de9-108e-44e0-9c90-23157edd4502 tempest-GroupSnapshotsTest-707872509 None] Delete group completed successfully. Apr 27 23:57:26 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] 8f48a915-9605-48af-ab48-fa6fc721c0a5 was qcow2, converting to raw {{(pid=81312) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:26 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 Apr 27 23:57:26 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] group_snapshot a4e82940-8a65-46ff-93d9-0e74ef750247: deleting Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] group_snapshot a4e82940-8a65-46ff-93d9-0e74ef750247: deleting {{(pid=81312) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-78696d48-373b-44ee-945f-2ef67a7e0a95" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-78696d48-373b-44ee-945f-2ef67a7e0a95" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Deleting offline snapshot 78696d48-373b-44ee-945f-2ef67a7e0a95 of volume b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] snapshot_file for this snap is: volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[19586270-7c68-4d8f-999e-6c2b527c871a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:26 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 Apr 27 23:57:26 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:27 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95" returned: 0 in 0.601s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:27 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:57:27 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a56e50-2979-4cbc-aa26-8237f6483286]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:27 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 Apr 27 23:57:27 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:27 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381" returned: 0 in 1.369s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:27 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5_rtgy1if8devstack@QuobyteHD, size 112.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:57:27 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Converted 112.00 MB image at 81.71 MB/s Apr 27 23:57:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:27 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 1G Apr 27 23:57:27 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:28 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" returned: 0 in 0.561s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:28 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 Apr 27 23:57:28 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:28 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 1G" returned: 0 in 0.481s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:28 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3869918-3bb5-4dc1-9bd4-bb301ceef62c]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:28 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 Apr 27 23:57:28 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:28 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95" returned: 0 in 0.561s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:28 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95 Apr 27 23:57:28 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:28 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381" returned: 0 in 0.546s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:28 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 Apr 27 23:57:28 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:29 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183.78696d48-373b-44ee-945f-2ef67a7e0a95" returned: 0 in 0.453s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-78696d48-373b-44ee-945f-2ef67a7e0a95" released by "_delete_snapshot" :: held 2.271s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" released by "delete_snapshot" :: held 2.304s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:29 devstack cinder-volume[81312]: WARNING cinder.quota [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1845485711 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1845485711, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['553cac21-829f-42fb-a263-0171631f87c9', '4b0805b0-e7b4-4e6f-914e-4ee1c3ef928a', 'f8e0c4d5-95bf-41d7-b5c9-db041bd53495', '6bb868ab-82a8-4c72-ae5e-2b3ce912b3f4'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:29 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:29 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6876b881-d446-496f-b836-647d82b56636 tempest-GroupSnapshotsTest-707872509 None] group_snapshot a4e82940-8a65-46ff-93d9-0e74ef750247: deleted successfully Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381" returned: 1 in 0.533s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Downloaded image 8f48a915-9605-48af-ab48-fa6fc721c0a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}])) to volume a92a3638-2d69-458b-81e5-2e1001367381 successfully. {{(pid=81312) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Temporary image 8f48a915-9605-48af-ab48-fa6fc721c0a5 for user 0319d1292ed840109ed760dfe3cd6c72 is deleted. {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Marking volume a92a3638-2d69-458b-81e5-2e1001367381 as bootable. {{(pid=81312) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Copying metadata from image 8f48a915-9605-48af-ab48-fa6fc721c0a5 to a92a3638-2d69-458b-81e5-2e1001367381. {{(pid=81312) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Creating volume glance metadata for volume a92a3638-2d69-458b-81e5-2e1001367381 backed by image 8f48a915-9605-48af-ab48-fa6fc721c0a5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81312) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de0703-f9a6-4da5-96df-4865de834c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92a3638-2d69-458b-81e5-2e1001367381', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c18ab9-7a9d-4253-ad33-a89ab1f6c4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:29 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Volume volume-a92a3638-2d69-458b-81e5-2e1001367381 (a92a3638-2d69-458b-81e5-2e1001367381): created successfully Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c18ab9-7a9d-4253-ad33-a89ab1f6c4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Flow 'volume_create_manager' (dfecb5a8-e1df-447d-b6c4-83b470d24c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:29 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-718e2ea8-8986-49c9-a17d-19a8de4642e2 tempest-VolumesExtendTest-298027181 None] Created volume successfully. Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fccff4-f9bb-42ff-bbcc-abbd08ad586a]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:29 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 Apr 27 23:57:29 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdcd79a-07a7-4b7d-b507-862df6fc5cb4]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:30 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381" returned: 0 in 0.537s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:30 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 Apr 27 23:57:30 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:30 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 Apr 27 23:57:30 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:30 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" returned: 0 in 0.513s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:30 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183 Apr 27 23:57:30 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:30 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381" returned: 1 in 0.514s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 2G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 2G" returned: 0 in 0.065s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.157s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:30 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-58ef8228-2baf-49e9-a610-3d33c563d78f tempest-VolumesExtendTest-298027181 None] Extend volume completed successfully. Apr 27 23:57:31 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" returned: 0 in 0.444s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-b7c1b0a7-6cd5-4e0e-a690-abbecada7183" released by "delete_volume" :: held 1.017s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['898d0dfc-556b-4637-914d-6b53082f5a6c'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:31 devstack cinder-volume[81312]: WARNING cinder.db.sqlalchemy.api [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1845485711'] Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['e2e6cf5a-d8dc-43f8-84e0-8d995f5e107c', 'fed79101-3773-42be-888c-8c211a0256e5', 'f1030b1e-3ab5-4029-a2ac-f3b1dc796d79', '87fdcc8b-95d5-4108-a553-601584c1601b'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:31 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:31 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:31 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.437s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:31 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:31 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-101ca221-7c41-426f-933b-b82ac5206e38 tempest-GroupSnapshotsTest-707872509 None] Delete group completed successfully. Apr 27 23:57:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Acquiring lock "cinder-a92a3638-2d69-458b-81e5-2e1001367381-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Lock "cinder-a92a3638-2d69-458b-81e5-2e1001367381-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Acquiring lock "cinder-quobyte-a92a3638-2d69-458b-81e5-2e1001367381" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Lock "cinder-quobyte-a92a3638-2d69-458b-81e5-2e1001367381" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:32 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be1397a-6de7-4309-bce1-26f749013dae]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:32 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 Apr 27 23:57:32 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:32 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381" returned: 0 in 0.538s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:32 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6683bc56-cecf-4fc4-b286-30ccfd0c8ac3 tempest-GroupSnapshotsTest-707872509 None] Group tempest-GroupSnapshotsTest-Group-1646493210: creating Apr 27 23:57:32 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6683bc56-cecf-4fc4-b286-30ccfd0c8ac3 tempest-GroupSnapshotsTest-707872509 None] Group tempest-GroupSnapshotsTest-Group-1646493210: created successfully Apr 27 23:57:32 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 Apr 27 23:57:32 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:32 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6683bc56-cecf-4fc4-b286-30ccfd0c8ac3 tempest-GroupSnapshotsTest-707872509 None] Create group completed successfully. Apr 27 23:57:33 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381" returned: 1 in 0.539s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:33 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381 Apr 27 23:57:33 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:33 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-a92a3638-2d69-458b-81e5-2e1001367381" returned: 0 in 0.416s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Lock "cinder-quobyte-a92a3638-2d69-458b-81e5-2e1001367381" released by "delete_volume" :: held 1.557s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Created reservations ['cafd91e8-4cb1-44cd-866f-902ebc175079', '4ac1409c-8c7e-4638-8a15-cedb3d52e561', '725d64ce-6af6-4cc5-a75c-2b823fa2b2af', '6e8fe3be-ea35-415c-8f70-260828651145'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:33 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:33 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Flow 'volume_create_manager' (84755a72-6b4b-4c9b-84f1-55b6fd0455b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f484719-2376-446f-8991-84adc68eb142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f484719-2376-446f-8991-84adc68eb142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1917770848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b004de1-650c-458c-a329-dd33e042fba9,host='devstack@QuobyteHD#QuobyteHD',id=f324c388-58c6-4065-a5bb-101c35304ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2ede8372d4c20b06a604f3089d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:34Z,use_quota=True,user_id='ed6f9b3d4af041e3bde6e7a847cc3a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6d5f68-a2ef-4b6a-bc58-cd739c4554bc),volume_type_id=df6d5f68-a2ef-4b6a-bc58-cd739c4554bc)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0ad8a5-5fb0-4806-a7cc-02647a2de275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0ad8a5-5fb0-4806-a7cc-02647a2de275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7d4c6b-68c6-442d-9092-390df4c574b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7d4c6b-68c6-442d-9092-390df4c574b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f324c388-58c6-4065-a5bb-101c35304ae5', 'volume_name': 'volume-f324c388-58c6-4065-a5bb-101c35304ae5', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5e3335-0d25-4bbf-b333-818d6532671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5e3335-0d25-4bbf-b333-818d6532671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fd0745-1975-45e7-be26-d1b91bb76da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:34 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Volume f324c388-58c6-4065-a5bb-101c35304ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f324c388-58c6-4065-a5bb-101c35304ae5', 'volume_size': 1} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1b004de1-650c-458c-a329-dd33e042fba9,created_at=2026-04-27T21:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1917770848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b004de1-650c-458c-a329-dd33e042fba9,host='devstack@QuobyteHD#QuobyteHD',id=f324c388-58c6-4065-a5bb-101c35304ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2ede8372d4c20b06a604f3089d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:34Z,use_quota=True,user_id='ed6f9b3d4af041e3bde6e7a847cc3a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6d5f68-a2ef-4b6a-bc58-cd739c4554bc),volume_type_id=df6d5f68-a2ef-4b6a-bc58-cd739c4554bc)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Creating volume f324c388-58c6-4065-a5bb-101c35304ae5 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:57:34 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.532s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:34 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 1073741824 Apr 27 23:57:34 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Deleted volume successfully. Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-580d99d4-732d-458d-865f-95d1037dc819 tempest-VolumesExtendTest-298027181 None] Lock "cinder-a92a3638-2d69-458b-81e5-2e1001367381-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Flow 'volume_create_manager' (89d55bc1-b799-4e18-bbe2-53cb0f2e3aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bccdf5e-cc29-4226-a7c0-19303d3d6d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bccdf5e-cc29-4226-a7c0-19303d3d6d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-567464105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c05b9f-0149-49a0-a842-62ac0fcb8c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921a1e5e5fb44257972faf7104e3a33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:35Z,use_quota=True,user_id='0319d1292ed840109ed760dfe3cd6c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a71880-138c-478a-8f37-e561a25c837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a71880-138c-478a-8f37-e561a25c837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac1a2a9-6c01-4fb1-a754-1ee466d3166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac1a2a9-6c01-4fb1-a754-1ee466d3166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c05b9f-0149-49a0-a842-62ac0fcb8c8e', 'volume_name': 'volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a7d94a-3c7d-4454-a25a-9dd5781072e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a7d94a-3c7d-4454-a25a-9dd5781072e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f428debe-ac96-4f4c-9d6d-3df97cdbf126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:34 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Volume 90c05b9f-0149-49a0-a842-62ac0fcb8c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e', 'volume_size': 1} Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:34 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 1073741824" returned: 0 in 0.619s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:35 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 Apr 27 23:57:35 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:35 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-567464105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c05b9f-0149-49a0-a842-62ac0fcb8c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921a1e5e5fb44257972faf7104e3a33f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:35Z,use_quota=True,user_id='0319d1292ed840109ed760dfe3cd6c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Creating volume 90c05b9f-0149-49a0-a842-62ac0fcb8c8e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:57:35 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fd0745-1975-45e7-be26-d1b91bb76da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f324c388-58c6-4065-a5bb-101c35304ae5', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:35 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e 1073741824 Apr 27 23:57:35 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83de13b4-0fca-4f9e-9b81-037957672375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:35 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Volume volume-f324c388-58c6-4065-a5bb-101c35304ae5 (f324c388-58c6-4065-a5bb-101c35304ae5): created successfully Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83de13b4-0fca-4f9e-9b81-037957672375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Flow 'volume_create_manager' (84755a72-6b4b-4c9b-84f1-55b6fd0455b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:35 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7475ab6f-49f8-499d-a444-f84ea24d4cd6 tempest-GroupSnapshotsTest-707872509 None] Created volume successfully. Apr 27 23:57:36 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e 1073741824" returned: 0 in 0.592s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:36 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e Apr 27 23:57:36 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:36 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" returned: 0 in 0.438s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f428debe-ac96-4f4c-9d6d-3df97cdbf126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60db7710-0d50-4354-8002-247e4f81813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:36 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Volume volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e (90c05b9f-0149-49a0-a842-62ac0fcb8c8e): created successfully Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60db7710-0d50-4354-8002-247e4f81813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Flow 'volume_create_manager' (89d55bc1-b799-4e18-bbe2-53cb0f2e3aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f5130ac9-5d04-4d24-a759-13dc6ae9c0b2 tempest-VolumesExtendTest-298027181 None] Created volume successfully. Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Flow 'volume_create_manager' (c8c5610b-fd70-44d4-b8b1-20abee00c5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fb9a4c-3937-4aa4-94e6-6e6dfd0b609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fb9a4c-3937-4aa4-94e6-6e6dfd0b609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1557496841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b004de1-650c-458c-a329-dd33e042fba9,host='devstack@QuobyteHD#QuobyteHD',id=327db4d3-edfe-499c-885f-dd0c63a72013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2ede8372d4c20b06a604f3089d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:37Z,use_quota=True,user_id='ed6f9b3d4af041e3bde6e7a847cc3a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6d5f68-a2ef-4b6a-bc58-cd739c4554bc),volume_type_id=df6d5f68-a2ef-4b6a-bc58-cd739c4554bc)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d57041f-0aad-4392-89ed-1f683a9e6780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d57041f-0aad-4392-89ed-1f683a9e6780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f670029-3f88-42ea-a814-82f3d46cd463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f670029-3f88-42ea-a814-82f3d46cd463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327db4d3-edfe-499c-885f-dd0c63a72013', 'volume_name': 'volume-327db4d3-edfe-499c-885f-dd0c63a72013', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a33b27-ef7c-4bb5-8b7c-6222c00ca521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a33b27-ef7c-4bb5-8b7c-6222c00ca521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eed177c-1fa5-421f-ac7f-6731af5a3927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:36 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Volume 327db4d3-edfe-499c-885f-dd0c63a72013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327db4d3-edfe-499c-885f-dd0c63a72013', 'volume_size': 1} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1b004de1-650c-458c-a329-dd33e042fba9,created_at=2026-04-27T21:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1557496841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b004de1-650c-458c-a329-dd33e042fba9,host='devstack@QuobyteHD#QuobyteHD',id=327db4d3-edfe-499c-885f-dd0c63a72013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2ede8372d4c20b06a604f3089d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:37Z,use_quota=True,user_id='ed6f9b3d4af041e3bde6e7a847cc3a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df6d5f68-a2ef-4b6a-bc58-cd739c4554bc),volume_type_id=df6d5f68-a2ef-4b6a-bc58-cd739c4554bc)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Creating volume 327db4d3-edfe-499c-885f-dd0c63a72013 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:57:36 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:36 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 1073741824 Apr 27 23:57:36 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:37 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 1073741824" returned: 0 in 0.600s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:37 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 Apr 27 23:57:37 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:37 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:57:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.004s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eed177c-1fa5-421f-ac7f-6731af5a3927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327db4d3-edfe-499c-885f-dd0c63a72013', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef21ae9-44e5-446f-9553-699d4783438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Creating offline snapshot 5c958a61-de15-448d-83cb-d296d9779f3e of volume 90c05b9f-0149-49a0-a842-62ac0fcb8c8e {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:57:38 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Volume volume-327db4d3-edfe-499c-885f-dd0c63a72013 (327db4d3-edfe-499c-885f-dd0c63a72013): created successfully Apr 27 23:57:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef21ae9-44e5-446f-9553-699d4783438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Flow 'volume_create_manager' (c8c5610b-fd70-44d4-b8b1-20abee00c5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:38 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31bc697-3b2d-4831-85f3-1462acfab10f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:38 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-23484ac7-c30b-422c-8045-49459dbdc554 tempest-GroupSnapshotsTest-707872509 None] Created volume successfully. Apr 27 23:57:38 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e Apr 27 23:57:38 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:38 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" returned: 0 in 0.506s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:38 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e 1G Apr 27 23:57:38 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:39 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f1e0444b-f81c-421b-99bc-5cf59c15324b tempest-GroupSnapshotsTest-707872509 None] Update group completed successfully. Apr 27 23:57:39 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e 1G" returned: 0 in 0.649s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:39 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e Apr 27 23:57:39 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:39 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e" returned: 0 in 0.462s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:39 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e is being set with open permissions: ugo+rw Apr 27 23:57:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:39 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e Apr 27 23:57:39 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:40 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e" returned: 0 in 0.461s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:40 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.info Apr 27 23:57:40 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:40 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f2d23760-ee00-4bdf-aec8-6aafb18eec29 tempest-GroupSnapshotsTest-707872509 None] Update group completed successfully. Apr 27 23:57:40 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.info" returned: 0 in 0.479s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:40 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.info is being set with open permissions: ugo+rw Apr 27 23:57:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:40 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.info Apr 27 23:57:40 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:41 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.info" returned: 0 in 0.458s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.122s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:41 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b1d23513-9c19-4518-bb1b-1f8f70f75f92 tempest-VolumesExtendTest-298027181 None] Create snapshot completed successfully Apr 27 23:57:41 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-116d7fac-f0cc-4943-af8e-5a93ade1f86d tempest-GroupSnapshotsTest-707872509 None] Update group completed successfully. Apr 27 23:57:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5b4c184-9a1e-4ace-a299-39fcd0463470 tempest-VolumesExtendTest-298027181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5b4c184-9a1e-4ace-a299-39fcd0463470 tempest-VolumesExtendTest-298027181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:42 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5fc421-c92a-4715-9080-f07eb1767af8]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5b4c184-9a1e-4ace-a299-39fcd0463470 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:42 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e Apr 27 23:57:42 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:42 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-053a71d4-ae67-4486-9f99-4471ce3d08b2 tempest-GroupSnapshotsTest-707872509 None] Update group completed successfully. Apr 27 23:57:42 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5b4c184-9a1e-4ace-a299-39fcd0463470 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" returned: 0 in 0.533s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5b4c184-9a1e-4ace-a299-39fcd0463470 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e 2G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5b4c184-9a1e-4ace-a299-39fcd0463470 tempest-VolumesExtendTest-298027181 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e 2G" returned: 0 in 0.119s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5b4c184-9a1e-4ace-a299-39fcd0463470 tempest-VolumesExtendTest-298027181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.682s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:42 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c5b4c184-9a1e-4ace-a299-39fcd0463470 tempest-VolumesExtendTest-298027181 None] Extend volume completed successfully. Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Acquiring lock "cinder-5c958a61-de15-448d-83cb-d296d9779f3e-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Lock "cinder-5c958a61-de15-448d-83cb-d296d9779f3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Acquiring lock "cinder-quobyte-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Lock "cinder-quobyte-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Acquiring lock "cinder-quobyte-5c958a61-de15-448d-83cb-d296d9779f3e" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Lock "cinder-quobyte-5c958a61-de15-448d-83cb-d296d9779f3e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Deleting offline snapshot 5c958a61-de15-448d-83cb-d296d9779f3e of volume 90c05b9f-0149-49a0-a842-62ac0fcb8c8e {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] snapshot_file for this snap is: volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ede283-b7b2-4710-8f72-0779b5b8433d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:43 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e Apr 27 23:57:43 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:43 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] GroupSnapshot f9bafe8d-e90e-4220-a2ba-e5a08c533e70: creating. Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Group snapshot f9bafe8d-e90e-4220-a2ba-e5a08c533e70: creating. {{(pid=81312) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Creating offline snapshot 65a9582b-7439-4a9f-8291-34ca59700483 of volume f324c388-58c6-4065-a5bb-101c35304ae5 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e0c27b-c6c9-44cf-8d8c-6f83c7755f10]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:44 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 Apr 27 23:57:44 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:44 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e" returned: 0 in 0.526s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:57:44 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e541c0d3-efea-4476-8814-6055c77ac24a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:44 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e Apr 27 23:57:44 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:44 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5" returned: 0 in 0.523s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:44 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 1G Apr 27 23:57:44 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:44 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" returned: 0 in 0.523s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:44 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e Apr 27 23:57:44 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:45 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:45 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:45 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 1G" returned: 0 in 0.607s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f324c388-58c6-4065-a5bb-101c35304ae5 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:45 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f324c388-58c6-4065-a5bb-101c35304ae5 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 Apr 27 23:57:45 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:45 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e" returned: 0 in 0.623s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:45 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e Apr 27 23:57:45 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:45 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.431s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:45 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f324c388-58c6-4065-a5bb-101c35304ae5 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483" returned: 0 in 0.531s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:45 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:45 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 Apr 27 23:57:45 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:45 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e.5c958a61-de15-448d-83cb-d296d9779f3e" returned: 0 in 0.454s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Lock "cinder-quobyte-5c958a61-de15-448d-83cb-d296d9779f3e" released by "_delete_snapshot" :: held 2.226s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Lock "cinder-quobyte-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" released by "delete_snapshot" :: held 2.246s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Created reservations ['abbdc278-35d8-402f-a42b-233080a43b40', '5c28e9d3-7626-4777-86e7-67c879061aab', '1be5bdaf-3b71-44b0-b763-7c77fb58791a', 'a563ff56-8218-4de8-86db-42fbc9f8b198'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:45 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Delete snapshot completed successfully. Apr 27 23:57:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-495eb6c5-6e81-46c8-8ad1-792c8f65df62 tempest-VolumesExtendTest-298027181 None] Lock "cinder-5c958a61-de15-448d-83cb-d296d9779f3e-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:46 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483" returned: 0 in 0.447s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:46 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.info Apr 27 23:57:46 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:46 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.info" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:46 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:46 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.info Apr 27 23:57:46 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Acquiring lock "cinder-90c05b9f-0149-49a0-a842-62ac0fcb8c8e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Lock "cinder-90c05b9f-0149-49a0-a842-62ac0fcb8c8e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Acquiring lock "cinder-quobyte-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Lock "cinder-quobyte-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cc2771-79b5-4b53-8a18-a9292733d97c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:46 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e Apr 27 23:57:46 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:47 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.info" returned: 0 in 0.507s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.126s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Creating offline snapshot d89609db-33f3-4857-ae49-aa594753af8f of volume 327db4d3-edfe-499c-885f-dd0c63a72013 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e936fc93-0ea4-4588-8775-79f1902970ed]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:47 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 Apr 27 23:57:47 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:47 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" returned: 0 in 0.508s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:47 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e Apr 27 23:57:47 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:47 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013" returned: 0 in 0.534s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:47 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f 1G Apr 27 23:57:47 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:47 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" returned: 0 in 0.442s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Lock "cinder-quobyte-90c05b9f-0149-49a0-a842-62ac0fcb8c8e" released by "delete_volume" :: held 1.016s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Created reservations ['97934281-33a0-4d51-8101-237c9e847f85', 'ac3a8046-3477-44b4-9ddc-19e4b58d04dd', '4b615ade-c112-45b4-b4ed-6daa2c6b5f68', 'e3a5fae6-19fe-44e8-b369-16f93344c4e1'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:47 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:47 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:48 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f 1G" returned: 0 in 0.605s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327db4d3-edfe-499c-885f-dd0c63a72013 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:48 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327db4d3-edfe-499c-885f-dd0c63a72013 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f Apr 27 23:57:48 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:48 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.462s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:48 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:48 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Deleted volume successfully. Apr 27 23:57:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-10d536f6-4f39-4822-9677-b98674dbbfe0 tempest-VolumesExtendTest-298027181 None] Lock "cinder-90c05b9f-0149-49a0-a842-62ac0fcb8c8e-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:48 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327db4d3-edfe-499c-885f-dd0c63a72013 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f" returned: 0 in 0.479s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:48 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:57:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:48 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f Apr 27 23:57:48 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:49 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f" returned: 0 in 0.476s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:49 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.info Apr 27 23:57:49 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:49 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.info" returned: 0 in 0.489s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:49 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:57:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:49 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.info Apr 27 23:57:49 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:50 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.info" returned: 0 in 0.483s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.146s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:50 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f901add1-1d97-45e4-bcfa-9b116486df99 tempest-GroupSnapshotsTest-707872509 None] group_snapshot f9bafe8d-e90e-4220-a2ba-e5a08c533e70: created successfully Apr 27 23:57:51 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] group_snapshot f9bafe8d-e90e-4220-a2ba-e5a08c533e70: deleting Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (7d507e5c-2da1-42dd-a21a-32093b0f2fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f3cae9-8e8e-4ff0-aa3a-e7a174906afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] group_snapshot f9bafe8d-e90e-4220-a2ba-e5a08c533e70: deleting {{(pid=81312) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f3cae9-8e8e-4ff0-aa3a-e7a174906afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1237335278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8f360f-6b3d-465a-8b2d-9aab72e3e644,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:51Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb599e4-1049-4dc0-9d0e-9833639fad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb599e4-1049-4dc0-9d0e-9833639fad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58e5bf2-7273-4aab-b08f-402b9e3b2422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58e5bf2-7273-4aab-b08f-402b9e3b2422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8f360f-6b3d-465a-8b2d-9aab72e3e644', 'volume_name': 'volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0075caf-1b42-4fa9-89c5-18c35a0ad98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0075caf-1b42-4fa9-89c5-18c35a0ad98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef47319-ed6c-4714-a609-3442e535d990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:51 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Volume af8f360f-6b3d-465a-8b2d-9aab72e3e644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644', 'volume_size': 1} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1237335278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8f360f-6b3d-465a-8b2d-9aab72e3e644,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:51Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Creating volume af8f360f-6b3d-465a-8b2d-9aab72e3e644 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:57:51 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:51 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 1073741824 Apr 27 23:57:51 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-f324c388-58c6-4065-a5bb-101c35304ae5" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-f324c388-58c6-4065-a5bb-101c35304ae5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-65a9582b-7439-4a9f-8291-34ca59700483" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-65a9582b-7439-4a9f-8291-34ca59700483" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Deleting offline snapshot 65a9582b-7439-4a9f-8291-34ca59700483 of volume f324c388-58c6-4065-a5bb-101c35304ae5 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] snapshot_file for this snap is: volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab2e35-8e7b-46d7-ac19-24c4cd1957ff]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:51 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 Apr 27 23:57:51 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:52 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 1073741824" returned: 0 in 0.635s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:52 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:52 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 Apr 27 23:57:52 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483" returned: 0 in 0.603s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f324c388-58c6-4065-a5bb-101c35304ae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bf97bc-e0b4-4dbb-b8d4-dac82dce114f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:52 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 Apr 27 23:57:52 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:52 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644" returned: 0 in 0.435s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef47319-ed6c-4714-a609-3442e535d990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c5fd01-9640-4498-b96c-20e093e49ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:52 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Volume volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 (af8f360f-6b3d-465a-8b2d-9aab72e3e644): created successfully Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c5fd01-9640-4498-b96c-20e093e49ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (7d507e5c-2da1-42dd-a21a-32093b0f2fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:52 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3f52a900-b3b8-4e19-a7c6-1df350da0ba5 tempest-VolumesGetTest-1478910537 None] Created volume successfully. Apr 27 23:57:52 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5" returned: 0 in 0.540s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:52 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 Apr 27 23:57:52 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:53 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483" returned: 0 in 0.527s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:53 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483 Apr 27 23:57:53 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:53 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5.65a9582b-7439-4a9f-8291-34ca59700483" returned: 0 in 0.443s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-65a9582b-7439-4a9f-8291-34ca59700483" released by "_delete_snapshot" :: held 2.201s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-f324c388-58c6-4065-a5bb-101c35304ae5" released by "delete_snapshot" :: held 2.225s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-327db4d3-edfe-499c-885f-dd0c63a72013" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-327db4d3-edfe-499c-885f-dd0c63a72013" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-d89609db-33f3-4857-ae49-aa594753af8f" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-d89609db-33f3-4857-ae49-aa594753af8f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Deleting offline snapshot d89609db-33f3-4857-ae49-aa594753af8f of volume 327db4d3-edfe-499c-885f-dd0c63a72013 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] snapshot_file for this snap is: volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbd92b5-48b7-49a7-8cf1-8647587e7ffc]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:53 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f Apr 27 23:57:53 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (03237a67-6aac-4364-98e8-0815fcdfb344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85861cef-0e0e-42e9-9f40-433b2b363b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85861cef-0e0e-42e9-9f40-433b2b363b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1158039123',display_name='tempest-VolumesGetTest-Volume-589179872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fecd76-1921-4fab-a52c-11325ccee466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:54Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ed53f1-457d-4e2e-a623-8d019ec6f00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ed53f1-457d-4e2e-a623-8d019ec6f00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5309c9c-1129-45f6-a88b-01cb5caa31e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5309c9c-1129-45f6-a88b-01cb5caa31e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55fecd76-1921-4fab-a52c-11325ccee466', 'volume_name': 'volume-55fecd76-1921-4fab-a52c-11325ccee466', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be63c619-1b31-40a6-9ee5-c1f9b0da29ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be63c619-1b31-40a6-9ee5-c1f9b0da29ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157dc243-459b-401c-9d71-3f0053a68620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:54 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Volume 55fecd76-1921-4fab-a52c-11325ccee466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55fecd76-1921-4fab-a52c-11325ccee466', 'volume_size': 1} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:57:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1158039123',display_name='tempest-VolumesGetTest-Volume-589179872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fecd76-1921-4fab-a52c-11325ccee466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:57:54Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Creating volume 55fecd76-1921-4fab-a52c-11325ccee466 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:57:54 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:54 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466 1073741824 Apr 27 23:57:54 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:54 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f" returned: 0 in 0.541s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-327db4d3-edfe-499c-885f-dd0c63a72013(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb4c2fe-602d-47f2-963a-d415d4920127]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:54 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 Apr 27 23:57:54 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:54 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466 1073741824" returned: 0 in 0.609s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:54 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466 Apr 27 23:57:54 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:55 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013" returned: 0 in 0.545s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:55 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f Apr 27 23:57:55 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:55 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466" returned: 0 in 0.444s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157dc243-459b-401c-9d71-3f0053a68620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55fecd76-1921-4fab-a52c-11325ccee466', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4e8241-180e-4dc1-8798-40badb4cf705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:57:55 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Volume volume-55fecd76-1921-4fab-a52c-11325ccee466 (55fecd76-1921-4fab-a52c-11325ccee466): created successfully Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4e8241-180e-4dc1-8798-40badb4cf705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (03237a67-6aac-4364-98e8-0815fcdfb344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:57:55 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-dfc74af1-92ab-46f1-ba4d-c029eb8e567d tempest-VolumesGetTest-1478910537 None] Created volume successfully. Apr 27 23:57:55 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f" returned: 0 in 0.564s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:55 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f Apr 27 23:57:55 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:56 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013.d89609db-33f3-4857-ae49-aa594753af8f" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-d89609db-33f3-4857-ae49-aa594753af8f" released by "_delete_snapshot" :: held 2.176s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-327db4d3-edfe-499c-885f-dd0c63a72013" released by "delete_snapshot" :: held 2.198s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:56 devstack cinder-volume[81312]: WARNING cinder.quota [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1376949818 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1376949818, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:57:56 devstack cinder-volume[81312]: WARNING cinder.quota [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1376949818 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1376949818, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['f6be064c-55d1-410f-9f25-1888b75def28', '3623c1c4-b79f-467b-ae05-db085d0558bf', '41188859-25c0-4d8e-88ae-929a1c868724', 'e92863cd-10c5-4330-9794-d29a62d6f7e5'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['7453772f-7e7b-423c-818d-a3deb570caf1', '760115ef-9256-4d10-a936-e091eb8d77cd', '3d22217b-d271-4d7e-911e-221f16a7823c', 'c42de987-1851-487a-92ad-e3c88b7ef38c'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:56 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1a93d852-df1f-465a-901c-468590bbaa63 tempest-GroupSnapshotsTest-707872509 None] group_snapshot f9bafe8d-e90e-4220-a2ba-e5a08c533e70: deleted successfully Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-55fecd76-1921-4fab-a52c-11325ccee466-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Lock "cinder-55fecd76-1921-4fab-a52c-11325ccee466-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-quobyte-55fecd76-1921-4fab-a52c-11325ccee466" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-55fecd76-1921-4fab-a52c-11325ccee466" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41482a0-57d1-4f1f-b05d-bb766d4f0564]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:56 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466 Apr 27 23:57:56 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:56 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466" returned: 0 in 0.515s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:56 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466 Apr 27 23:57:56 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-327db4d3-edfe-499c-885f-dd0c63a72013" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-327db4d3-edfe-499c-885f-dd0c63a72013" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2554319b-5576-4b97-92be-b0502938fbe5]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:57 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 Apr 27 23:57:57 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:57 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-55fecd76-1921-4fab-a52c-11325ccee466" returned: 0 in 0.470s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-55fecd76-1921-4fab-a52c-11325ccee466" released by "delete_volume" :: held 1.029s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Created reservations ['f2cd31a8-084c-485d-a214-77208e5d7541', '55969727-493a-46aa-91e1-c0937e979871', '6e2c1e23-7c4a-41a1-b701-5aca973f01c7', '8d3ca0b1-b41c-4d84-89e7-63d5504692cb'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:57 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:57 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:57 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013" returned: 0 in 0.534s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:57 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013 Apr 27 23:57:57 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:57 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.445s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:57:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Deleted volume successfully. Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-83b668df-59dc-41ea-9cde-bb6657fb6aed tempest-VolumesGetTest-1478910537 None] Lock "cinder-55fecd76-1921-4fab-a52c-11325ccee466-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:58 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-327db4d3-edfe-499c-885f-dd0c63a72013" returned: 0 in 0.441s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-327db4d3-edfe-499c-885f-dd0c63a72013" released by "delete_volume" :: held 1.035s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-f324c388-58c6-4065-a5bb-101c35304ae5" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-f324c388-58c6-4065-a5bb-101c35304ae5" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d0107a-fed6-430c-b1a4-c16e1f5f001a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:58 devstack sudo[87885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 Apr 27 23:57:58 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-af8f360f-6b3d-465a-8b2d-9aab72e3e644-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Lock "cinder-af8f360f-6b3d-465a-8b2d-9aab72e3e644-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-quobyte-af8f360f-6b3d-465a-8b2d-9aab72e3e644" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-af8f360f-6b3d-465a-8b2d-9aab72e3e644" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f350981-77ff-4a8e-a8c3-48d6c031f2c7]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:58 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5" returned: 0 in 0.572s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:58 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 Apr 27 23:57:58 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:58 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5 Apr 27 23:57:58 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:59 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f324c388-58c6-4065-a5bb-101c35304ae5" returned: 0 in 0.468s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-f324c388-58c6-4065-a5bb-101c35304ae5" released by "delete_volume" :: held 1.100s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:59 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644" returned: 0 in 0.548s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:59 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644 Apr 27 23:57:59 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['78873d0e-d70f-4271-8e5b-d300ca32234b'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:59 devstack cinder-volume[81312]: WARNING cinder.quota [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1376949818 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1376949818, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['a95feb02-35b7-447f-84fd-264472937afc', '5a2a4872-3095-47aa-8323-8fd7fba37541', 'c6355c96-9073-40d2-9556-1597e903b8c1', 'e36741f5-18dd-44ba-ac3d-89ea685f3850'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['751437df-90e2-4e6a-a859-139b01bae1c3', '1a7f45e6-f672-40a5-9b5e-3f79226e67e6', 'b1f17060-8cdd-459b-8f72-eb37945b85dd', 'cd9d7b6f-5095-46e7-9b8c-9349e46b0b77'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:59 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:59 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:57:59 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-af8f360f-6b3d-465a-8b2d-9aab72e3e644" returned: 0 in 0.479s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-af8f360f-6b3d-465a-8b2d-9aab72e3e644" released by "delete_volume" :: held 1.069s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Created reservations ['0a102d78-6789-4193-aa02-6b9ff7291d57', '568e4cbe-92f0-4f57-963c-a2badc5313a1', '6338270a-ff22-48f6-8f26-c869dc728b7c', '814f1927-effc-432d-8f0f-d532c11e0f83'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:57:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:57:59 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:57:59 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:00 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:00 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0c0c327a-5433-4483-ace5-c6aefc1605a1 tempest-GroupSnapshotsTest-707872509 None] Delete group completed successfully. Apr 27 23:58:00 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.445s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:00 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Deleted volume successfully. Apr 27 23:58:00 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6a7c95c6-bf2f-445f-8509-0e1a8e9621fa tempest-VolumesGetTest-1478910537 None] Lock "cinder-af8f360f-6b3d-465a-8b2d-9aab72e3e644-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e1a01165-9665-491e-971c-198e6e0cc39a tempest-GroupSnapshotsTest-707872509 None] Group tempest-GroupSnapshotsTest-Group-1341647603: creating Apr 27 23:58:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e1a01165-9665-491e-971c-198e6e0cc39a tempest-GroupSnapshotsTest-707872509 None] Group tempest-GroupSnapshotsTest-Group-1341647603: created successfully Apr 27 23:58:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e1a01165-9665-491e-971c-198e6e0cc39a tempest-GroupSnapshotsTest-707872509 None] Create group completed successfully. Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (679e3fae-2d35-42ca-ab06-b01b8e4b40b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8103e1-0981-4eec-85e6-c381641ee273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8103e1-0981-4eec-85e6-c381641ee273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1183463560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf5d260-3f62-4527-b041-e6bf3723e0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:01Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc749a4-4959-46d9-8718-fd849092a6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc749a4-4959-46d9-8718-fd849092a6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a03c5b4-4daa-4d42-8863-9de413121831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a03c5b4-4daa-4d42-8863-9de413121831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bf5d260-3f62-4527-b041-e6bf3723e0f4', 'volume_name': 'volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9877bb-df41-433b-a0c6-5aa001757935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9877bb-df41-433b-a0c6-5aa001757935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a84da3-b9cb-4c39-9909-b54e68eceb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:01 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Volume 4bf5d260-3f62-4527-b041-e6bf3723e0f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4', 'volume_size': 1} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1183463560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bf5d260-3f62-4527-b041-e6bf3723e0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:01Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Creating volume 4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:58:01 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:01 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 1073741824 Apr 27 23:58:01 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:01 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 1073741824" returned: 0 in 0.630s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:01 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 Apr 27 23:58:01 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Flow 'volume_create_manager' (79d915a2-2016-4f3e-8dcf-fe7505aa8ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbe11e0-7003-4ce8-baf7-794d2eb77c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbe11e0-7003-4ce8-baf7-794d2eb77c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039483903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=267ecc07-22d5-46ab-891c-5a78e98762dc,host='devstack@QuobyteHD#QuobyteHD',id=cddd33a5-908d-4905-aac9-1671311e3f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2ede8372d4c20b06a604f3089d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:02Z,use_quota=True,user_id='ed6f9b3d4af041e3bde6e7a847cc3a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf25702d-f323-434b-8fd5-b0e42f601ec6),volume_type_id=bf25702d-f323-434b-8fd5-b0e42f601ec6)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f1261d-e6b1-4934-8c07-1617f768fa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f1261d-e6b1-4934-8c07-1617f768fa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f2a01-7d6f-41d2-884e-2f8bfc7330e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f2a01-7d6f-41d2-884e-2f8bfc7330e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cddd33a5-908d-4905-aac9-1671311e3f50', 'volume_name': 'volume-cddd33a5-908d-4905-aac9-1671311e3f50', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb4d1df-5f7d-4a0b-8981-df81ab65fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb4d1df-5f7d-4a0b-8981-df81ab65fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4e9ebe-52d1-4d00-9914-535336d6706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:02 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Volume cddd33a5-908d-4905-aac9-1671311e3f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cddd33a5-908d-4905-aac9-1671311e3f50', 'volume_size': 1} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:02 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4" returned: 0 in 0.465s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=267ecc07-22d5-46ab-891c-5a78e98762dc,created_at=2026-04-27T21:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039483903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=267ecc07-22d5-46ab-891c-5a78e98762dc,host='devstack@QuobyteHD#QuobyteHD',id=cddd33a5-908d-4905-aac9-1671311e3f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2ede8372d4c20b06a604f3089d137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:02Z,use_quota=True,user_id='ed6f9b3d4af041e3bde6e7a847cc3a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf25702d-f323-434b-8fd5-b0e42f601ec6),volume_type_id=bf25702d-f323-434b-8fd5-b0e42f601ec6)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Creating volume cddd33a5-908d-4905-aac9-1671311e3f50 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:58:02 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a84da3-b9cb-4c39-9909-b54e68eceb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:02 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 1073741824 Apr 27 23:58:02 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1ff3f8-d40c-4e9d-9064-53c986fea23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:02 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Volume volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 (4bf5d260-3f62-4527-b041-e6bf3723e0f4): created successfully Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1ff3f8-d40c-4e9d-9064-53c986fea23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (679e3fae-2d35-42ca-ab06-b01b8e4b40b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:02 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e0ddbbf3-7cd7-4867-847a-6eae0b837148 tempest-VolumesGetTest-1478910537 None] Created volume successfully. Apr 27 23:58:02 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 1073741824" returned: 0 in 0.604s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:02 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 Apr 27 23:58:02 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:03 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50" returned: 0 in 0.447s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4e9ebe-52d1-4d00-9914-535336d6706e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cddd33a5-908d-4905-aac9-1671311e3f50', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1676e5ed-a5c0-4f38-b80d-f9598fb8078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:03 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Volume volume-cddd33a5-908d-4905-aac9-1671311e3f50 (cddd33a5-908d-4905-aac9-1671311e3f50): created successfully Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1676e5ed-a5c0-4f38-b80d-f9598fb8078f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Flow 'volume_create_manager' (79d915a2-2016-4f3e-8dcf-fe7505aa8ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:03 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5ad0200b-9e80-4ed9-a8c8-26020eb9b997 tempest-GroupSnapshotsTest-707872509 None] Created volume successfully. Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (da84d18b-e3e2-4a8f-9594-4a654b003f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c9506c-3fd9-4a6a-b4ea-fcf22315a944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c9506c-3fd9-4a6a-b4ea-fcf22315a944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1020102771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4bf5d260-3f62-4527-b041-e6bf3723e0f4,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:04Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a8fcc0-f085-413e-ba5e-cfb76b0d46ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a8fcc0-f085-413e-ba5e-cfb76b0d46ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2160fc69-9452-4a01-9e31-68e25c8fa4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2160fc69-9452-4a01-9e31-68e25c8fa4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8', 'volume_name': 'volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8', 'volume_size': 1, 'source_volid': '4bf5d260-3f62-4527-b041-e6bf3723e0f4', 'source_volstatus': 'available'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca154353-cf17-4c5e-9ddc-c2c88eb7db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca154353-cf17-4c5e-9ddc-c2c88eb7db05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96c8631-7d40-4fb2-8b28-5f2697471cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:03 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Volume 0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8', 'volume_size': 1, 'source_volid': '4bf5d260-3f62-4527-b041-e6bf3723e0f4', 'source_volstatus': 'available'} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:03 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Cloning volume 4bf5d260-3f62-4527-b041-e6bf3723e0f4 to volume 0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Creating offline snapshot a3af692f-79c5-468a-9464-8c8f8930f57c of volume 4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c87f057-ce30-45f0-baa6-9b4eb52804e5]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:03 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 Apr 27 23:58:03 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:04 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:04 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c 1G Apr 27 23:58:04 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:04 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] GroupSnapshot 8ca1c9a2-380a-41d4-887a-c7a7feff98b9: creating. Apr 27 23:58:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Group snapshot 8ca1c9a2-380a-41d4-887a-c7a7feff98b9: creating. {{(pid=81312) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 27 23:58:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:04 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c 1G" returned: 0 in 0.614s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:04 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c Apr 27 23:58:04 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:05 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c" returned: 0 in 0.471s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:05 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c is being set with open permissions: ugo+rw Apr 27 23:58:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:05 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c Apr 27 23:58:05 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:05 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c" returned: 0 in 0.434s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:05 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.info Apr 27 23:58:05 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:06 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.info" returned: 0 in 0.434s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:06 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.info is being set with open permissions: ugo+rw Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:06 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.info Apr 27 23:58:06 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:06 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.info" returned: 0 in 0.431s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-quobyte-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] snapshot: a3af692f-79c5-468a-9464-8c8f8930f57c, volume: 0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c11d5b2-0393-413e-8e23-4f469205c0bc]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:06 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c Apr 27 23:58:06 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:07 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c" returned: 0 in 0.507s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:58:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 23:58:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 23:58:07 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[88374aa5-4081-42e8-8206-f8e0d30b4b12]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:07 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 Apr 27 23:58:07 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:07 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4" returned: 0 in 0.516s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:07 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 23:58:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:07 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 Apr 27 23:58:07 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:12 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" returned: 0 in 4.624s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:12 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eafb430-38fd-42ff-849d-243eabe2ca77]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:12 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 Apr 27 23:58:12 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:13 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4" returned: 0 in 0.633s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:58:13 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Converted 1024.00 MB image at 221.41 MB/s Apr 27 23:58:13 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 is being set with open permissions: ugo+rw Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:13 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 Apr 27 23:58:13 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:13 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" returned: 0 in 0.423s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" released by "_copy_volume_from_snapshot" :: held 6.784s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-quobyte-a3af692f-79c5-468a-9464-8c8f8930f57c" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-a3af692f-79c5-468a-9464-8c8f8930f57c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Deleting offline snapshot a3af692f-79c5-468a-9464-8c8f8930f57c of volume 4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] snapshot_file for this snap is: volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba809f58-d06b-4a72-806b-5f458ed9cf76]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:13 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c Apr 27 23:58:13 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:14 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c" returned: 0 in 0.521s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:58:14 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d44b49-478c-4220-af98-4c697090bf2d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:14 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 Apr 27 23:58:14 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:14 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4" returned: 0 in 0.496s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:14 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c Apr 27 23:58:14 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:15 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c" returned: 0 in 0.534s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:15 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c Apr 27 23:58:15 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:15 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4.a3af692f-79c5-468a-9464-8c8f8930f57c" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-a3af692f-79c5-468a-9464-8c8f8930f57c" released by "_delete_snapshot" :: held 2.070s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.928s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.076s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96c8631-7d40-4fb2-8b28-5f2697471cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8', 'volume_size': 1, 'source_volid': '4bf5d260-3f62-4527-b041-e6bf3723e0f4', 'source_volstatus': 'available'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb37724-f2ba-43ce-800a-75a4686be09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Creating offline snapshot bc62c4dc-8f52-489e-9ead-23b90c61b59f of volume cddd33a5-908d-4905-aac9-1671311e3f50 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:58:15 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Volume volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 (0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8): created successfully Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb37724-f2ba-43ce-800a-75a4686be09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (da84d18b-e3e2-4a8f-9594-4a654b003f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab941d2-776b-4e4a-826b-56b19bb6fac0]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-04c1204c-a96f-45c2-8ca3-b6c83dced81b tempest-VolumesGetTest-1478910537 None] Created volume successfully. Apr 27 23:58:15 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 Apr 27 23:58:15 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:16 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50" returned: 0 in 0.513s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:16 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f 1G Apr 27 23:58:16 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:16 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f 1G" returned: 0 in 0.628s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cddd33a5-908d-4905-aac9-1671311e3f50 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:16 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cddd33a5-908d-4905-aac9-1671311e3f50 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f Apr 27 23:58:16 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (c09ba5ed-a838-4f3e-9a95-256d9a58b802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e427be27-55c4-44ae-ba0e-defe93cbb5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e427be27-55c4-44ae-ba0e-defe93cbb5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1883414139',display_name='tempest-VolumesGetTest-Volume-130966191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c271cdb-9447-407f-b547-ac726f41cccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:17Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c63bbe-3075-4bbc-9f6d-962efde350c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c63bbe-3075-4bbc-9f6d-962efde350c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc5ee2e-49d5-4202-b998-bb23df5d8a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc5ee2e-49d5-4202-b998-bb23df5d8a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c271cdb-9447-407f-b547-ac726f41cccc', 'volume_name': 'volume-0c271cdb-9447-407f-b547-ac726f41cccc', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e96a7cf-53c6-49c1-923f-52f19e2aac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e96a7cf-53c6-49c1-923f-52f19e2aac2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb632580-8b90-4d8f-b7fe-46e7155d12ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:17 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Volume 0c271cdb-9447-407f-b547-ac726f41cccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c271cdb-9447-407f-b547-ac726f41cccc', 'volume_size': 1} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:17 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cddd33a5-908d-4905-aac9-1671311e3f50 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f" returned: 0 in 0.515s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:17 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:17 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f Apr 27 23:58:17 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:17 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f" returned: 0 in 0.428s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:17 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.info Apr 27 23:58:17 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:18 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.info" returned: 0 in 0.442s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:18 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:18 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.info Apr 27 23:58:18 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:18 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.info" returned: 0 in 0.430s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.603s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1883414139',display_name='tempest-VolumesGetTest-Volume-130966191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c271cdb-9447-407f-b547-ac726f41cccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:17Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Creating volume 0c271cdb-9447-407f-b547-ac726f41cccc {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:58:18 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:58:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:18 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc 1073741824 Apr 27 23:58:18 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:18 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-bfee8b66-3879-4ec8-a62e-c3c2b722348d tempest-GroupSnapshotsTest-707872509 None] group_snapshot 8ca1c9a2-380a-41d4-887a-c7a7feff98b9: created successfully Apr 27 23:58:19 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] group_snapshot 8ca1c9a2-380a-41d4-887a-c7a7feff98b9: deleting Apr 27 23:58:19 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] group_snapshot 8ca1c9a2-380a-41d4-887a-c7a7feff98b9: deleting {{(pid=81312) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc 1073741824" returned: 0 in 0.679s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-cddd33a5-908d-4905-aac9-1671311e3f50" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-cddd33a5-908d-4905-aac9-1671311e3f50" acquired by "delete_snapshot" :: waited 0.040s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-bc62c4dc-8f52-489e-9ead-23b90c61b59f" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:19 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc Apr 27 23:58:19 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-bc62c4dc-8f52-489e-9ead-23b90c61b59f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Deleting offline snapshot bc62c4dc-8f52-489e-9ead-23b90c61b59f of volume cddd33a5-908d-4905-aac9-1671311e3f50 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] snapshot_file for this snap is: volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bd2e93-2e61-40c1-97d0-7a1c8774e3f6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:19 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f Apr 27 23:58:19 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:19 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc" returned: 0 in 0.459s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb632580-8b90-4d8f-b7fe-46e7155d12ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c271cdb-9447-407f-b547-ac726f41cccc', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6a8345-a358-42f9-a0a0-7f010d7fb399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:19 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Volume volume-0c271cdb-9447-407f-b547-ac726f41cccc (0c271cdb-9447-407f-b547-ac726f41cccc): created successfully Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6a8345-a358-42f9-a0a0-7f010d7fb399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (c09ba5ed-a838-4f3e-9a95-256d9a58b802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:19 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2d70352b-a8f0-46d5-bf7b-2ee73dfbb1aa tempest-VolumesGetTest-1478910537 None] Created volume successfully. Apr 27 23:58:20 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f" returned: 0 in 0.528s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cddd33a5-908d-4905-aac9-1671311e3f50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1759fae-7006-4d21-93ed-e95d2a135f8b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:20 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 Apr 27 23:58:20 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-0c271cdb-9447-407f-b547-ac726f41cccc-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Lock "cinder-0c271cdb-9447-407f-b547-ac726f41cccc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-quobyte-0c271cdb-9447-407f-b547-ac726f41cccc" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-0c271cdb-9447-407f-b547-ac726f41cccc" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e29be0-896b-4320-b739-ab4189e16364]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:20 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc Apr 27 23:58:20 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:20 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50" returned: 0 in 0.560s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:20 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f Apr 27 23:58:20 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:20 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc" returned: 0 in 0.511s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:20 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc Apr 27 23:58:20 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:21 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f" returned: 0 in 0.540s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:21 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f Apr 27 23:58:21 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:21 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0c271cdb-9447-407f-b547-ac726f41cccc" returned: 0 in 0.457s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-0c271cdb-9447-407f-b547-ac726f41cccc" released by "delete_volume" :: held 1.014s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Created reservations ['edc73f59-3347-426e-956d-78e65624172f', '9fc5f4d6-26f9-4edf-9b9b-e080930eaaff', '1755000b-7671-4850-972b-0f43b253d49a', 'ecdeee48-62fc-4f50-aeef-d489863d63d5'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:21 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:58:21 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:21 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50.bc62c4dc-8f52-489e-9ead-23b90c61b59f" returned: 0 in 0.442s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-bc62c4dc-8f52-489e-9ead-23b90c61b59f" released by "_delete_snapshot" :: held 2.170s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-cddd33a5-908d-4905-aac9-1671311e3f50" released by "delete_snapshot" :: held 2.206s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:21 devstack cinder-volume[81312]: WARNING cinder.quota [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1761439799 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1761439799, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:58:21 devstack cinder-volume[81312]: WARNING cinder.quota [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1761439799 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1761439799, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:58:21 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] Created reservations ['e9ae3f8e-0b4f-47a6-9309-59e2131028b2', 'c5edd548-0e32-488b-9d03-53bf68faf0aa', '7bb9432f-5707-4298-b34f-df2eb006d622', '5ac5de89-4117-4db2-a5c5-43e360aa9ddc'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:21 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-07965eb3-5722-4a91-8ca7-ba16182173f8 tempest-GroupSnapshotsTest-707872509 None] group_snapshot 8ca1c9a2-380a-41d4-887a-c7a7feff98b9: deleted successfully Apr 27 23:58:22 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.465s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:22 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Deleted volume successfully. Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-999a5f35-2c3a-485e-9869-a8c20e386fed tempest-VolumesGetTest-1478910537 None] Lock "cinder-0c271cdb-9447-407f-b547-ac726f41cccc-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Lock "cinder-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-quobyte-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1a2154-f2c0-42fb-9b73-4e3a5f91fb0c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:22 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 Apr 27 23:58:22 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "cinder-quobyte-cddd33a5-908d-4905-aac9-1671311e3f50" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-cddd33a5-908d-4905-aac9-1671311e3f50" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a3ede0-6684-47e1-adba-e18a22ad5f48]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:23 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 Apr 27 23:58:23 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:23 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" returned: 0 in 0.564s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:23 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8 Apr 27 23:58:23 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:23 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50" returned: 0 in 0.526s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:23 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50 Apr 27 23:58:23 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:23 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" returned: 0 in 0.465s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8" released by "delete_volume" :: held 1.075s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Created reservations ['06be584a-65b2-4824-b465-e7475e18f20e', '24ba5a81-cd41-4269-bcd4-5de5c477e191', '92a90441-fae4-4959-8a0c-0137626f6600', 'bca7fd22-b5a8-40f8-ada9-3232ac05dc06'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:23 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:58:23 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:23 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-cddd33a5-908d-4905-aac9-1671311e3f50" returned: 0 in 0.464s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Lock "cinder-quobyte-cddd33a5-908d-4905-aac9-1671311e3f50" released by "delete_volume" :: held 1.062s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Created reservations ['ff6ff9c1-13d7-467c-b5ec-1e235ff8f455'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:24 devstack cinder-volume[81312]: WARNING cinder.quota [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1761439799 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1761439799, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Created reservations ['9fa476aa-9732-46f2-bf30-ca34d6587a5a', '38b7cc50-39f4-4fdd-bd28-2c421109c9de', '059c9a16-ed92-4ae1-90f3-e916e71cfaf1', 'e569520d-4499-4e5d-8fbe-8461e21f0cdb'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:24 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:58:24 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:24 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.468s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:24 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Deleted volume successfully. Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-801bc855-c2b5-42e9-baf2-0bf165508951 tempest-VolumesGetTest-1478910537 None] Lock "cinder-0fe5bd67-db3d-4fb6-80be-6c6ce0a41ff8-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:24 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.425s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:24 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e13bcbae-0b73-4738-bd59-2f3a3289934c tempest-GroupSnapshotsTest-707872509 None] Delete group completed successfully. Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-4bf5d260-3f62-4527-b041-e6bf3723e0f4-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Lock "cinder-4bf5d260-3f62-4527-b041-e6bf3723e0f4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:UPDATE=176,cinder:SELECT=167,cinder:INSERT=41,cinder:DELETE=9 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=157,cinder:UPDATE=180,cinder:INSERT=54,cinder:DELETE=8 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-quobyte-4bf5d260-3f62-4527-b041-e6bf3723e0f4" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-4bf5d260-3f62-4527-b041-e6bf3723e0f4" acquired by "delete_volume" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abfb361-bcab-459a-a709-1bd95874814f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:25 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 Apr 27 23:58:25 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:25 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4" returned: 0 in 0.559s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:25 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4 Apr 27 23:58:25 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:26 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4bf5d260-3f62-4527-b041-e6bf3723e0f4" returned: 0 in 0.478s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-4bf5d260-3f62-4527-b041-e6bf3723e0f4" released by "delete_volume" :: held 1.098s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Created reservations ['e280c32d-b878-4093-b8ef-4eea1b660ac3', 'af6515c1-47e1-4b34-b483-9f83164a55f5', '290ea4c8-e5b8-4920-8ca7-bc82c1a9f130', 'aeae8531-92ea-4284-b3d8-e6f96256d8a5'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:26 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:58:26 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:26 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.469s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Deleted volume successfully. Apr 27 23:58:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc0f3fb7-c00c-4a8b-8ea6-b8d8ace6fc80 tempest-VolumesGetTest-1478910537 None] Lock "cinder-4bf5d260-3f62-4527-b041-e6bf3723e0f4-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:27 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:58:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (95eeeffd-b119-4061-aee0-00ca33f3e73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:27 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbad67e-56b5-4303-a251-6ab20657ecbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbad67e-56b5-4303-a251-6ab20657ecbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1754482779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f000420-0245-41c0-a74a-53cc7c259291,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:28Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ca7da8-ac27-4fb0-82a3-8ea18615d6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ca7da8-ac27-4fb0-82a3-8ea18615d6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad26b2b-1041-4d64-861f-0094215b50f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.image.glance [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Creating Keystone auth plugin from conf {{(pid=81312) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad26b2b-1041-4d64-861f-0094215b50f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f000420-0245-41c0-a74a-53cc7c259291', 'volume_name': 'volume-3f000420-0245-41c0-a74a-53cc7c259291', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88147e52-b8bc-45d6-892a-ef400866387c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88147e52-b8bc-45d6-892a-ef400866387c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335023e3-d2e9-4ea6-b03d-f8d322f55a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:28 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Volume 3f000420-0245-41c0-a74a-53cc7c259291: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f000420-0245-41c0-a74a-53cc7c259291', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Trying to clone 3f000420-0245-41c0-a74a-53cc7c259291 from image 8f48a915-9605-48af-ab48-fa6fc721c0a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]). {{(pid=81312) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 27 23:58:28 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Image download 20.69 MB at 20.69 MB/s Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e9703c-96a2-4a4e-a705-3ff2aa6ab766]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:28 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD Apr 27 23:58:28 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:29 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD" returned: 0 in 0.546s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Temporary image 8f48a915-9605-48af-ab48-fa6fc721c0a5 is fetched for user 1345e7c00386487ba09ded949c4fd624. {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b661b7bf-c768-4ff8-8a62-4d1c05df2d2b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:29 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD Apr 27 23:58:29 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:29 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD" returned: 0 in 0.516s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1754482779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f000420-0245-41c0-a74a-53cc7c259291,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:28Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Creating volume 3f000420-0245-41c0-a74a-53cc7c259291 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:58:29 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:58:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:29 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 1073741824 Apr 27 23:58:29 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:30 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 1073741824" returned: 0 in 0.658s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:30 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 Apr 27 23:58:30 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:31 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291" returned: 0 in 0.474s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:58:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:31 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Attempting download of 8f48a915-9605-48af-ab48-fa6fc721c0a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}])) to volume 3f000420-0245-41c0-a74a-53cc7c259291. {{(pid=81312) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 27 23:58:31 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e073ed-3f6e-4bd4-b2c7-1319c9d6b839]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ss8lwt92 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:31 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ss8lwt92 Apr 27 23:58:31 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:31 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ss8lwt92" returned: 0 in 0.546s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ss8lwt92 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:31 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ss8lwt92 Apr 27 23:58:31 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:32 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ss8lwt92" returned: 1 in 0.570s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f48a915-9605-48af-ab48-fa6fc721c0a5_ss8lwt92' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:58:32 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2456d9ae-f66c-47f1-84da-82441b29c796]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:32 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD Apr 27 23:58:32 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:32 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD" returned: 0 in 0.509s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:32 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] 8f48a915-9605-48af-ab48-fa6fc721c0a5 was qcow2, converting to raw {{(pid=81312) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 27 23:58:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:32 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 Apr 27 23:58:32 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:33 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7798bf3e-285c-4829-8907-f6ef9007a928 tempest-GroupsV314Test-1113420676 None] Group tempest-GroupsV314Test-Group-414891978: creating Apr 27 23:58:33 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7798bf3e-285c-4829-8907-f6ef9007a928 tempest-GroupsV314Test-1113420676 None] Group tempest-GroupsV314Test-Group-414891978: created successfully Apr 27 23:58:33 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7798bf3e-285c-4829-8907-f6ef9007a928 tempest-GroupsV314Test-1113420676 None] Create group completed successfully. Apr 27 23:58:34 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291" returned: 0 in 1.400s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:34 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8f48a915-9605-48af-ab48-fa6fc721c0a5__cvdzo15devstack@QuobyteHD, size 112.00 MB, duration 1.40 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:58:34 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Converted 112.00 MB image at 79.95 MB/s Apr 27 23:58:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:34 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 1G Apr 27 23:58:34 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:34 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 1G" returned: 0 in 0.481s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:34 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31a0472-82f9-482e-be92-8f36cd8ec542]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:34 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 Apr 27 23:58:34 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:35 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291" returned: 0 in 0.533s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:58:35 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 Apr 27 23:58:35 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Flow 'volume_create_manager' (f065bb26-e21f-480f-8f53-2a4155b92f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9116a9f2-8f41-45b9-9b54-9bd56f130990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9116a9f2-8f41-45b9-9b54-9bd56f130990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1209145850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62b5fe5a-be86-4171-a24b-d13a2201944e,host='devstack@QuobyteHD#QuobyteHD',id=aaa0f934-170c-4c72-9956-af47c0853d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b6825c61be43ee8230bb7dde165224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:35Z,use_quota=True,user_id='a8b2efd78d764de5b598db4d6fbc2648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(159890d0-0ed8-4cee-97bd-029d983e9439),volume_type_id=159890d0-0ed8-4cee-97bd-029d983e9439)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503ac822-e2b6-4f71-b4a2-ac7060a364b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503ac822-e2b6-4f71-b4a2-ac7060a364b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4ec37a-33f4-47e3-a9d4-c2f9bebf4ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4ec37a-33f4-47e3-a9d4-c2f9bebf4ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa0f934-170c-4c72-9956-af47c0853d5c', 'volume_name': 'volume-aaa0f934-170c-4c72-9956-af47c0853d5c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a1d63-2936-46d7-bced-026a3d2128f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a1d63-2936-46d7-bced-026a3d2128f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58feeca8-4566-4e56-9b39-c9ff6ae5dae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:35 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Volume aaa0f934-170c-4c72-9956-af47c0853d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa0f934-170c-4c72-9956-af47c0853d5c', 'volume_size': 1} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62b5fe5a-be86-4171-a24b-d13a2201944e,created_at=2026-04-27T21:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1209145850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62b5fe5a-be86-4171-a24b-d13a2201944e,host='devstack@QuobyteHD#QuobyteHD',id=aaa0f934-170c-4c72-9956-af47c0853d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b6825c61be43ee8230bb7dde165224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:35Z,use_quota=True,user_id='a8b2efd78d764de5b598db4d6fbc2648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(159890d0-0ed8-4cee-97bd-029d983e9439),volume_type_id=159890d0-0ed8-4cee-97bd-029d983e9439)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Creating volume aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:58:35 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:35 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c 1073741824 Apr 27 23:58:35 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:35 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291" returned: 1 in 0.523s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Downloaded image 8f48a915-9605-48af-ab48-fa6fc721c0a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}])) to volume 3f000420-0245-41c0-a74a-53cc7c259291 successfully. {{(pid=81312) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Temporary image 8f48a915-9605-48af-ab48-fa6fc721c0a5 for user 1345e7c00386487ba09ded949c4fd624 is deleted. {{(pid=81312) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.volume_utils [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Marking volume 3f000420-0245-41c0-a74a-53cc7c259291 as bootable. {{(pid=81312) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Copying metadata from image 8f48a915-9605-48af-ab48-fa6fc721c0a5 to 3f000420-0245-41c0-a74a-53cc7c259291. {{(pid=81312) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Creating volume glance metadata for volume 3f000420-0245-41c0-a74a-53cc7c259291 backed by image 8f48a915-9605-48af-ab48-fa6fc721c0a5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81312) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335023e3-d2e9-4ea6-b03d-f8d322f55a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f000420-0245-41c0-a74a-53cc7c259291', 'volume_size': 1, 'image_id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f48a915-9605-48af-ab48-fa6fc721c0a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '28324d39fca748d9a14f84fc6083c65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8f48a915-9605-48af-ab48-fa6fc721c0a5', 'created_at': datetime.datetime(2026, 4, 27, 21, 45, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 21, 45, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f48a915-9605-48af-ab48-fa6fc721c0a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beda1f2e-1d67-4fc5-827b-8a5396560559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:35 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Volume volume-3f000420-0245-41c0-a74a-53cc7c259291 (3f000420-0245-41c0-a74a-53cc7c259291): created successfully Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beda1f2e-1d67-4fc5-827b-8a5396560559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (95eeeffd-b119-4061-aee0-00ca33f3e73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:35 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-62253d09-6a15-48f7-82e2-0f8d82d00275 tempest-VolumesGetTest-1478910537 None] Created volume successfully. Apr 27 23:58:36 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c 1073741824" returned: 0 in 0.616s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:36 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c Apr 27 23:58:36 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:36 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58feeca8-4566-4e56-9b39-c9ff6ae5dae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa0f934-170c-4c72-9956-af47c0853d5c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b99e42-137d-450a-8d8e-0ce52b242298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:36 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Volume volume-aaa0f934-170c-4c72-9956-af47c0853d5c (aaa0f934-170c-4c72-9956-af47c0853d5c): created successfully Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b99e42-137d-450a-8d8e-0ce52b242298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Flow 'volume_create_manager' (f065bb26-e21f-480f-8f53-2a4155b92f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-68cf1b8f-6254-4579-9896-05a5f369c9d7 tempest-GroupsV314Test-1113420676 None] Created volume successfully. Apr 27 23:58:36 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (07a44bd3-4b1f-4646-befa-ac0e8d000ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8814a7-7cbf-4467-b76f-85c2d3038b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8814a7-7cbf-4467-b76f-85c2d3038b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1834801615',display_name='tempest-VolumesGetTest-Volume-1120034779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:37Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b3dded-55c9-42a4-aed5-4423205433a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b3dded-55c9-42a4-aed5-4423205433a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2630c588-8dd9-463f-ac10-e715cbf6789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2630c588-8dd9-463f-ac10-e715cbf6789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc', 'volume_name': 'volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b396b049-33f9-49ca-9cc3-44fd5808746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b396b049-33f9-49ca-9cc3-44fd5808746f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911fb1c3-fa9a-471e-a61f-8aa1d58a48ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:37 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Volume 69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc', 'volume_size': 1} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1834801615',display_name='tempest-VolumesGetTest-Volume-1120034779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1ceffbe0d84cbf9bac06944dd3d634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:37Z,use_quota=True,user_id='1345e7c00386487ba09ded949c4fd624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Creating volume 69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:58:37 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:37 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc 1073741824 Apr 27 23:58:37 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:37 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc 1073741824" returned: 0 in 0.622s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:37 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc Apr 27 23:58:37 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:38 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc" returned: 0 in 0.452s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911fb1c3-fa9a-471e-a61f-8aa1d58a48ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d530271e-8b08-4a9a-83f9-b4567ddcc899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:38 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Volume volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc (69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc): created successfully Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d530271e-8b08-4a9a-83f9-b4567ddcc899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Flow 'volume_create_manager' (07a44bd3-4b1f-4646-befa-ac0e8d000ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:38 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6c5cccc0-7e7c-42fe-8e21-74296c1b8348 tempest-VolumesGetTest-1478910537 None] Created volume successfully. Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:38 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Cloning volume aaa0f934-170c-4c72-9956-af47c0853d5c to volume ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Creating offline snapshot 3e496839-c59f-4e62-876d-266e91143505 of volume aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cd1335-ecab-44eb-b5c2-995a8648471e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:38 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c Apr 27 23:58:38 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:39 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c" returned: 0 in 0.536s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:39 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 1G Apr 27 23:58:39 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Lock "cinder-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-quobyte-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3179d7a4-b88f-42a5-bdeb-a159b13ec0d0]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:39 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc Apr 27 23:58:39 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:39 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 1G" returned: 0 in 0.602s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa0f934-170c-4c72-9956-af47c0853d5c -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:39 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa0f934-170c-4c72-9956-af47c0853d5c -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 Apr 27 23:58:39 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:39 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc" returned: 0 in 0.557s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:39 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc Apr 27 23:58:39 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:40 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa0f934-170c-4c72-9956-af47c0853d5c -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505" returned: 0 in 0.496s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:40 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:40 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 Apr 27 23:58:40 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:40 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc" returned: 0 in 0.458s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc" released by "delete_volume" :: held 1.054s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Created reservations ['6eac01d0-28e0-4953-a19e-11768c7dbd7e', '691fae56-37ec-4139-a88e-5a8bdb320845', '2ac4e8b8-1472-4fbc-8c50-780da0838824', '8f792394-95d0-4b2e-a212-6e8291f681a6'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:40 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:58:40 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:40 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:40 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.info Apr 27 23:58:40 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:40 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:40 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Deleted volume successfully. Apr 27 23:58:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b1303d2-b192-4d97-ba59-eba8fd1c007b tempest-VolumesGetTest-1478910537 None] Lock "cinder-69ee6e16-c178-4e1f-a7f8-c4af0cbf43dc-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:41 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.info" returned: 0 in 0.466s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:41 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:41 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.info Apr 27 23:58:41 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:41 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.info" returned: 0 in 0.466s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Acquiring lock "cinder-quobyte-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-3f000420-0245-41c0-a74a-53cc7c259291-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Lock "cinder-quobyte-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] snapshot: 3e496839-c59f-4e62-876d-266e91143505, volume: ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Lock "cinder-3f000420-0245-41c0-a74a-53cc7c259291-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0345c9d1-6e75-4c34-8234-0b41a324713b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Acquiring lock "cinder-quobyte-3f000420-0245-41c0-a74a-53cc7c259291" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-3f000420-0245-41c0-a74a-53cc7c259291" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:41 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 Apr 27 23:58:41 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04ddc7c-b7a9-4caa-bd5f-57b6c870217c]: (4, 'raw') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:41 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 Apr 27 23:58:41 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:42 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505" returned: 0 in 0.519s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaa0f934-170c-4c72-9956-af47c0853d5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ed735-bf71-4e74-bb12-d22a9b2ffe65]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:42 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c Apr 27 23:58:42 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:42 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291" returned: 0 in 0.538s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:42 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 Apr 27 23:58:42 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:42 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c" returned: 0 in 0.520s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:42 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 Apr 27 23:58:42 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:42 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291" returned: 1 in 0.521s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291' failed. Not Retrying. {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 27 23:58:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:42 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291 Apr 27 23:58:42 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:43 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3f000420-0245-41c0-a74a-53cc7c259291" returned: 0 in 0.485s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Lock "cinder-quobyte-3f000420-0245-41c0-a74a-53cc7c259291" released by "delete_volume" :: held 1.605s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:43 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Created reservations ['9b4df55b-3c78-4a89-a0ad-9e7a7b369efc', '6e431c61-5e10-4ff9-84df-b53b472de23c', 'fa738cf1-d411-4d6a-8145-691016ccf4da', '6db55339-a9f6-46f3-a317-cbe2bad63330'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:43 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:58:43 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:44 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.807s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:44 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:44 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Deleted volume successfully. Apr 27 23:58:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5339eb9a-b8c1-4504-beb4-0599ace7c52d tempest-VolumesGetTest-1478910537 None] Lock "cinder-3f000420-0245-41c0-a74a-53cc7c259291-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:58:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:45 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:58:45 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:46 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.653s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:46 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:48 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" returned: 0 in 5.484s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[161b827b-5819-46aa-b97f-5d30733dd711]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:48 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c Apr 27 23:58:48 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Flow 'volume_create_manager' (6c6c933b-541d-48ba-a9f3-78a5d72af586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9f125a-226b-466a-9023-c0b5cbf7c2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9f125a-226b-466a-9023-c0b5cbf7c2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-407888116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da9b0e7bdbd458ab6a918db034c7e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:48Z,use_quota=True,user_id='4dcc5b2cf7f84c20ae8f938cf9d9dc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2d9e38-bc67-41f4-9344-e628f464da3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2d9e38-bc67-41f4-9344-e628f464da3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5a76d3-29f2-47f6-add8-e8c983bed7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5a76d3-29f2-47f6-add8-e8c983bed7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15', 'volume_name': 'volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16944dc3-0fee-4ca5-9718-c2ad5a4e2167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16944dc3-0fee-4ca5-9718-c2ad5a4e2167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60e9216-719f-4fb7-8f7b-4ea0a7d28adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:48 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Volume 6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15', 'volume_size': 1} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:48 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c" returned: 0 in 0.691s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:58:48 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Converted 1024.00 MB image at 186.69 MB/s Apr 27 23:58:48 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 is being set with open permissions: ugo+rw: NotImplementedError Apr 27 23:58:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:48 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 Apr 27 23:58:48 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:49 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" returned: 0 in 0.428s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Lock "cinder-quobyte-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" released by "_copy_volume_from_snapshot" :: held 7.730s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Acquiring lock "cinder-quobyte-3e496839-c59f-4e62-876d-266e91143505" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Lock "cinder-quobyte-3e496839-c59f-4e62-876d-266e91143505" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Deleting offline snapshot 3e496839-c59f-4e62-876d-266e91143505 of volume aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] snapshot_file for this snap is: volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[497ac32f-43b5-42f3-90cb-7f2292ee78e1]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:49 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 Apr 27 23:58:49 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:49 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505" returned: 0 in 0.501s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaa0f934-170c-4c72-9956-af47c0853d5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b5c68a-0214-43f8-a821-7330e0766f4a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:49 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c Apr 27 23:58:49 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:50 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c" returned: 0 in 0.510s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:50 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 Apr 27 23:58:50 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:50 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505" returned: 0 in 0.549s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:50 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505 Apr 27 23:58:50 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:51 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c.3e496839-c59f-4e62-876d-266e91143505" returned: 0 in 0.451s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Lock "cinder-quobyte-3e496839-c59f-4e62-876d-266e91143505" released by "_delete_snapshot" :: held 2.103s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.019s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.021s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-407888116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2da9b0e7bdbd458ab6a918db034c7e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:58:48Z,use_quota=True,user_id='4dcc5b2cf7f84c20ae8f938cf9d9dc7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Creating volume 6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:58:51 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:58:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:51 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 1073741824 Apr 27 23:58:51 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:51 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-abc56b7f-bb6e-44c2-b6bd-2f3323405cae tempest-GroupsV314Test-1113420676 None] Create group from source-group-62b5fe5a-be86-4171-a24b-d13a2201944e completed successfully. Apr 27 23:58:52 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 1073741824" returned: 0 in 0.600s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:52 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 Apr 27 23:58:52 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Acquiring lock "cinder-quobyte-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Lock "cinder-quobyte-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:52 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" returned: 0 in 0.494s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[47db70d2-e509-4055-aa97-31d5e1f0963e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60e9216-719f-4fb7-8f7b-4ea0a7d28adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be97e563-1952-4023-9ff1-f9665236232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:58:52 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Volume volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 (6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15): created successfully Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be97e563-1952-4023-9ff1-f9665236232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:58:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Flow 'volume_create_manager' (6c6c933b-541d-48ba-a9f3-78a5d72af586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:58:52 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e0271aaa-6e93-4b43-be60-b28abe602fac tempest-VolumesSnapshotListTestJSON-1967266595 None] Created volume successfully. Apr 27 23:58:52 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 Apr 27 23:58:52 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:53 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" returned: 0 in 0.513s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:53 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719 Apr 27 23:58:53 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:53 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Lock "cinder-quobyte-ffa8bd10-e9f6-4cb1-8f0c-055ac12b1719" released by "delete_volume" :: held 1.026s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Created reservations ['4e0f6685-2b13-4f93-a231-ce1649a30bd3'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:53 devstack cinder-volume[81312]: WARNING cinder.quota [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2092231236 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2092231236, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:58:53 devstack cinder-volume[81312]: WARNING cinder.quota [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2092231236 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2092231236, it is now deprecated. Please use the default quota class for default quota. Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Created reservations ['2dc2d9a0-f6fd-41ae-a3bb-4a8f34de1f12', '17d969e7-0e07-4b01-b120-a40a170be552', '98e5f751-2eea-4b0c-8010-8a8a0a3917a8', 'a52aedbb-51f9-4ef5-badf-a761a223b98e'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:53 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:58:53 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Creating offline snapshot 784cb208-f347-4e2f-a13d-4dae44914d8d of volume 6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7f7ce8-01d5-45f7-b024-8efd28b09468]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:54 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 Apr 27 23:58:54 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:54 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.461s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:54 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:54 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-325b80c4-457a-410e-8584-30c37b039793 tempest-GroupsV314Test-1113420676 None] Delete group completed successfully. Apr 27 23:58:54 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" returned: 0 in 0.542s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:54 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d 1G Apr 27 23:58:54 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Acquiring lock "cinder-quobyte-aaa0f934-170c-4c72-9956-af47c0853d5c" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:58:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Lock "cinder-quobyte-aaa0f934-170c-4c72-9956-af47c0853d5c" acquired by "delete_volume" :: waited 0.026s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:58:54 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ac5f8-366d-4d08-af3f-9d3c598518ad]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:55 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c Apr 27 23:58:55 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:55 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d 1G" returned: 0 in 0.622s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:55 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d Apr 27 23:58:55 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:55 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c" returned: 0 in 0.550s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:55 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c Apr 27 23:58:55 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:55 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d" returned: 0 in 0.483s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:55 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d is being set with open permissions: ugo+rw Apr 27 23:58:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:55 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d Apr 27 23:58:55 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:55 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-aaa0f934-170c-4c72-9956-af47c0853d5c" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Lock "cinder-quobyte-aaa0f934-170c-4c72-9956-af47c0853d5c" released by "delete_volume" :: held 1.052s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Created reservations ['d71f303f-4148-4044-a2c6-519a2bb86ad5'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Created reservations ['f2c43bd4-d6d7-4695-a372-324e76050c0d', 'a987dce9-2443-43bb-845e-2964294e516e', 'eaf4d042-f261-48af-9d5b-d1ddaadcd67b', '724bdf26-c3f2-497d-a3fe-20167512c6fe'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:58:56 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d" returned: 0 in 0.467s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:56 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.info Apr 27 23:58:56 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:56 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:58:56 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:56 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.info" returned: 0 in 0.443s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:56 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.info is being set with open permissions: ugo+rw Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:56 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.info Apr 27 23:58:56 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:56 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.448s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:56 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:58:56 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2dbf5497-d46a-4063-b0b6-6170d2ea54cf tempest-GroupsV314Test-1113420676 None] Delete group completed successfully. Apr 27 23:58:57 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.info" returned: 0 in 0.443s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.098s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:58:57 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3dfbf84e-c80e-47d6-a5be-bcd08352136a tempest-VolumesSnapshotListTestJSON-1967266595 None] Create snapshot completed successfully Apr 27 23:58:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:58:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:58:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Creating offline snapshot 64c78094-a364-4bf8-9e75-ca9718c4e9ab of volume 6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:58:58 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[016f275d-5cf4-4926-925c-1b4ff583a733]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:58:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:58 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d Apr 27 23:58:58 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:59 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d" returned: 0 in 0.583s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:58:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:59 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab 1G Apr 27 23:58:59 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:58:59 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 27 23:58:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab 1G" returned: 0 in 0.675s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:58:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:58:59 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab Apr 27 23:58:59 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:00 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab" returned: 0 in 0.533s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:00 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab is being set with open permissions: ugo+rw Apr 27 23:59:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:00 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab Apr 27 23:59:00 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:00 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab" returned: 0 in 0.501s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-df564296-4376-4a44-a117-06e73a077ed1 tempest-VolumesSnapshotListTestJSON-1967266595 None] Create snapshot completed successfully Apr 27 23:59:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Creating offline snapshot ab6e386b-aab8-451b-8019-b03f2fe75f13 of volume 6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:59:01 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb243d-a32d-4abd-b07b-d47644c66534]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:01 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab Apr 27 23:59:01 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:02 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab" returned: 0 in 0.590s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:02 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 1G Apr 27 23:59:02 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:03 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 1G" returned: 0 in 0.736s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:03 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 Apr 27 23:59:03 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:03 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13" returned: 0 in 0.550s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:03 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 is being set with open permissions: ugo+rw Apr 27 23:59:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:03 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 Apr 27 23:59:03 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:04 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13" returned: 0 in 0.551s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:04 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ff7c728b-5b7d-4221-8039-cb7bb11682b9 tempest-VolumesSnapshotListTestJSON-1967266595 None] Create snapshot completed successfully Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-ab6e386b-aab8-451b-8019-b03f2fe75f13-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-ab6e386b-aab8-451b-8019-b03f2fe75f13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-quobyte-ab6e386b-aab8-451b-8019-b03f2fe75f13" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-ab6e386b-aab8-451b-8019-b03f2fe75f13" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Deleting offline snapshot ab6e386b-aab8-451b-8019-b03f2fe75f13 of volume 6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] snapshot_file for this snap is: volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63ad570-e015-4198-99d0-8c8dfb08a60a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:05 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 Apr 27 23:59:05 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Flow 'volume_create_manager' (a1240fcf-1709-4262-88ad-170cc731b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99fc349-bd7e-4acf-ac42-7edc7e99453c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99fc349-bd7e-4acf-ac42-7edc7e99453c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-518969340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7214d645-f238-4663-9e35-d9f8be891338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e6a24a58d54a088d015f22573c434d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:59:06Z,use_quota=True,user_id='d2744828c7fa45948de30adfcf41ec77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7dcf0dd-07ac-4219-8851-8faccca374d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7dcf0dd-07ac-4219-8851-8faccca374d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79387b25-b0a6-4495-af8c-0431e823b57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79387b25-b0a6-4495-af8c-0431e823b57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7214d645-f238-4663-9e35-d9f8be891338', 'volume_name': 'volume-7214d645-f238-4663-9e35-d9f8be891338', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc185bc-7d46-4292-8aae-d68a19678bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc185bc-7d46-4292-8aae-d68a19678bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3022341-edf8-434d-856d-d0c575cb03e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:06 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Volume 7214d645-f238-4663-9e35-d9f8be891338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7214d645-f238-4663-9e35-d9f8be891338', 'volume_size': 1} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-518969340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7214d645-f238-4663-9e35-d9f8be891338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e6a24a58d54a088d015f22573c434d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:59:06Z,use_quota=True,user_id='d2744828c7fa45948de30adfcf41ec77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Creating volume 7214d645-f238-4663-9e35-d9f8be891338 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:59:06 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:06 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 1073741824 Apr 27 23:59:06 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:06 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13" returned: 0 in 0.578s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53d428f-4cf0-4f87-9ae0-883e2a3770d7]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:06 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab Apr 27 23:59:06 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:06 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 1073741824" returned: 0 in 0.631s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:06 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab" returned: 0 in 0.563s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:06 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 Apr 27 23:59:06 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:06 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 Apr 27 23:59:06 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:07 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3022341-edf8-434d-856d-d0c575cb03e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7214d645-f238-4663-9e35-d9f8be891338', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a03476-1fc4-4c48-966a-67cb0ea7366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:07 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Volume volume-7214d645-f238-4663-9e35-d9f8be891338 (7214d645-f238-4663-9e35-d9f8be891338): created successfully Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a03476-1fc4-4c48-966a-67cb0ea7366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Flow 'volume_create_manager' (a1240fcf-1709-4262-88ad-170cc731b179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:59:07 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-8dc27d23-43ee-44d6-9ea0-ab19f2014f11 tempest-SnapshotMetadataTestJSON-2052625545 None] Created volume successfully. Apr 27 23:59:07 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13" returned: 0 in 0.640s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:07 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13 Apr 27 23:59:07 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:07 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.ab6e386b-aab8-451b-8019-b03f2fe75f13" returned: 0 in 0.437s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-ab6e386b-aab8-451b-8019-b03f2fe75f13" released by "_delete_snapshot" :: held 2.310s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" released by "delete_snapshot" :: held 2.334s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:07 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Created reservations ['e062d13e-8b2c-4f0b-a164-b1f48fe4413e', 'd1b34687-9c9a-4376-9583-167fdd174bdb', '89907263-a07c-45a2-85ac-a5827cc5bc66', '9a095122-e2a6-4684-a11a-601b5273f4b5'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:08 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Delete snapshot completed successfully. Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cebe419e-b036-478a-bd37-c23b31ba6904 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-ab6e386b-aab8-451b-8019-b03f2fe75f13-delete_snapshot" released by "delete_snapshot" :: held 2.459s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Creating offline snapshot 7a6e020e-b893-4fc7-ae56-4ca85d44038d of volume 7214d645-f238-4663-9e35-d9f8be891338 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0259352f-db7b-4bef-a9d3-6b05ed084948]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:08 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 Apr 27 23:59:08 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-64c78094-a364-4bf8-9e75-ca9718c4e9ab-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-64c78094-a364-4bf8-9e75-ca9718c4e9ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-quobyte-64c78094-a364-4bf8-9e75-ca9718c4e9ab" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-64c78094-a364-4bf8-9e75-ca9718c4e9ab" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Deleting offline snapshot 64c78094-a364-4bf8-9e75-ca9718c4e9ab of volume 6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] snapshot_file for this snap is: volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d54edd-7cf5-45e6-a530-4eb3aef932bf]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:08 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338" returned: 0 in 0.547s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:08 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab Apr 27 23:59:08 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:08 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d 1G Apr 27 23:59:08 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:09 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab" returned: 0 in 0.520s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:09 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[450eb54f-98a5-4f0a-b1da-d2f201fc20c1]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:09 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d Apr 27 23:59:09 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:09 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d 1G" returned: 0 in 0.642s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7214d645-f238-4663-9e35-d9f8be891338 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:09 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7214d645-f238-4663-9e35-d9f8be891338 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d Apr 27 23:59:09 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:09 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d" returned: 0 in 0.551s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:09 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab Apr 27 23:59:09 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:10 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7214d645-f238-4663-9e35-d9f8be891338 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d" returned: 0 in 0.508s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:10 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d is being set with open permissions: ugo+rw Apr 27 23:59:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:10 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d Apr 27 23:59:10 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:10 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab" returned: 0 in 0.627s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:10 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab Apr 27 23:59:10 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:10 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:10 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.info Apr 27 23:59:10 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:11 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.64c78094-a364-4bf8-9e75-ca9718c4e9ab" returned: 0 in 0.492s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:11 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-64c78094-a364-4bf8-9e75-ca9718c4e9ab" released by "_delete_snapshot" :: held 2.282s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.info" returned: 0 in 0.466s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:11 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.info is being set with open permissions: ugo+rw Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" released by "delete_snapshot" :: held 2.320s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:11 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.info Apr 27 23:59:11 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Created reservations ['d850d36d-a340-41d2-a211-b59dfba5078a', 'd3be1899-e3f3-4b8b-b290-8a1ff93830f9', '2fc67164-1c86-420c-9c26-26aae6090776', '3f2d2062-0d9f-43dd-aa93-916647250971'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Delete snapshot completed successfully. Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-89dd74d7-05eb-4b06-a402-41136432da31 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-64c78094-a364-4bf8-9e75-ca9718c4e9ab-delete_snapshot" released by "delete_snapshot" :: held 2.479s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:11 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.info" returned: 0 in 0.488s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.267s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-44423f28-706a-4994-8803-2b14d894df77 tempest-SnapshotMetadataTestJSON-2052625545 None] Create snapshot completed successfully Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-784cb208-f347-4e2f-a13d-4dae44914d8d-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-784cb208-f347-4e2f-a13d-4dae44914d8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-quobyte-784cb208-f347-4e2f-a13d-4dae44914d8d" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-784cb208-f347-4e2f-a13d-4dae44914d8d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Deleting offline snapshot 784cb208-f347-4e2f-a13d-4dae44914d8d of volume 6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:59:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] snapshot_file for this snap is: volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:59:12 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef64d628-d8dc-491f-a38e-ed6a1f569bff]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:12 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d Apr 27 23:59:12 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:12 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d" returned: 0 in 0.540s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:12 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[11789e52-692c-4f6a-946d-5b3da9c3f311]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:12 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 Apr 27 23:59:12 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:13 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" returned: 0 in 0.542s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:13 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d Apr 27 23:59:13 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Acquiring lock "cinder-7a6e020e-b893-4fc7-ae56-4ca85d44038d-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-7a6e020e-b893-4fc7-ae56-4ca85d44038d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Acquiring lock "cinder-quobyte-7214d645-f238-4663-9e35-d9f8be891338" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-quobyte-7214d645-f238-4663-9e35-d9f8be891338" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Acquiring lock "cinder-quobyte-7a6e020e-b893-4fc7-ae56-4ca85d44038d" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-quobyte-7a6e020e-b893-4fc7-ae56-4ca85d44038d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Deleting offline snapshot 7a6e020e-b893-4fc7-ae56-4ca85d44038d of volume 7214d645-f238-4663-9e35-d9f8be891338 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] snapshot_file for this snap is: volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20320f9-acd3-4bc1-819b-b03056aec435]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:13 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d Apr 27 23:59:13 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:13 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d" returned: 0 in 0.549s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:13 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d Apr 27 23:59:13 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:13 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d" returned: 0 in 0.521s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7214d645-f238-4663-9e35-d9f8be891338(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2426abaf-5409-46fe-abac-66d8ebd7631f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:13 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 Apr 27 23:59:13 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:14 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15.784cb208-f347-4e2f-a13d-4dae44914d8d" returned: 0 in 0.438s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-784cb208-f347-4e2f-a13d-4dae44914d8d" released by "_delete_snapshot" :: held 2.178s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" released by "delete_snapshot" :: held 2.201s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:14 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Created reservations ['b272f121-9c8a-464a-88e4-f76d4a188804', '253efee0-e89c-4987-97de-c4977bd5f0cb', 'b3024f6b-377c-4a12-b5b5-69a5f1a8c08a', '5e0c6925-cbc9-443b-a285-c0894d12f56b'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:14 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Delete snapshot completed successfully. Apr 27 23:59:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c1feb06f-2283-40fe-9049-65e7f72fa53b tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-784cb208-f347-4e2f-a13d-4dae44914d8d-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:14 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338" returned: 0 in 0.522s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:14 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d Apr 27 23:59:14 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:14 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d" returned: 0 in 0.554s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:14 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d Apr 27 23:59:14 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef12cc49-619a-417b-a2c2-b7c5ac0b9770]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:15 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 Apr 27 23:59:15 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:15 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338.7a6e020e-b893-4fc7-ae56-4ca85d44038d" returned: 0 in 0.498s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-quobyte-7a6e020e-b893-4fc7-ae56-4ca85d44038d" released by "_delete_snapshot" :: held 2.194s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-quobyte-7214d645-f238-4663-9e35-d9f8be891338" released by "delete_snapshot" :: held 2.224s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Created reservations ['6b239d29-57e1-4bfa-9887-65b7a5943fae', '0d184bec-c7f7-47da-8547-6375629e7bb9', 'fd90d6c3-52d4-4f9e-a39c-2a517c2fe692', 'dd7da597-309d-4686-8147-fb6d2afc42c1'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Delete snapshot completed successfully. Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-dc90a159-64de-478a-82a9-a6339a3402a3 tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-7a6e020e-b893-4fc7-ae56-4ca85d44038d-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:15 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" returned: 0 in 0.552s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:15 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15 Apr 27 23:59:15 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:16 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" returned: 0 in 0.463s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-quobyte-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15" released by "delete_volume" :: held 1.078s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Created reservations ['9f51e91b-12cc-484d-ba27-a25aa4ed5518', 'e9c53028-0309-4739-a2d8-4445697228af', '83ed0187-c6b1-45d7-a06c-75b743212ba4', '3c236e36-15e1-4be7-87a7-446cad9c6111'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:16 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:59:16 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Acquiring lock "cinder-7214d645-f238-4663-9e35-d9f8be891338-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-7214d645-f238-4663-9e35-d9f8be891338-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Acquiring lock "cinder-quobyte-7214d645-f238-4663-9e35-d9f8be891338" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-quobyte-7214d645-f238-4663-9e35-d9f8be891338" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[778a5d6d-0582-4782-b4e8-40f331d622ad]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:16 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 Apr 27 23:59:16 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:16 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.490s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:59:16 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Deleted volume successfully. Apr 27 23:59:16 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b25847e8-6c27-414f-896f-25a83e3ccd69 tempest-VolumesSnapshotListTestJSON-1967266595 None] Lock "cinder-6bcb2e83-9264-4d1f-b8d4-531dd9b1cf15-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:17 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338" returned: 0 in 0.539s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:17 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338 Apr 27 23:59:17 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:17 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7214d645-f238-4663-9e35-d9f8be891338" returned: 0 in 0.489s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-quobyte-7214d645-f238-4663-9e35-d9f8be891338" released by "delete_volume" :: held 1.083s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Created reservations ['7e42e4d0-660d-4c35-8cd4-5b93235fa02f', '2918bcdf-d7fa-4f81-8f2e-0d8406983808', '8e6ee201-10e0-41fb-bcd3-ff8e6bc45578', 'fb0e6614-2db5-40e4-a195-c461fc9c58c8'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:17 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:59:17 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:18 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.488s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:18 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:59:18 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Deleted volume successfully. Apr 27 23:59:18 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5b55dc92-4e5e-4a2b-a5e2-de9e4037b0eb tempest-SnapshotMetadataTestJSON-2052625545 None] Lock "cinder-7214d645-f238-4663-9e35-d9f8be891338-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Flow 'volume_create_manager' (c6a75b8c-dfca-4b72-8e24-cdc674b9b407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a0fcaf-a74c-4516-9d8a-38d8e6c58523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a0fcaf-a74c-4516-9d8a-38d8e6c58523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1721163505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1afa759-69a0-49a8-870a-87b65256ad7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cd454f37dd494d877707f7b071aee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:59:21Z,use_quota=True,user_id='c485355aa52e47b580ae43bcfc4007a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f6c2b4-3452-4cf6-b529-97f84831ae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f6c2b4-3452-4cf6-b529-97f84831ae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ad4c93-b28e-4c4c-8aca-6b17095fa18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ad4c93-b28e-4c4c-8aca-6b17095fa18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1afa759-69a0-49a8-870a-87b65256ad7f', 'volume_name': 'volume-c1afa759-69a0-49a8-870a-87b65256ad7f', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b6198c-a1d9-4168-8791-a9b1903cf185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b6198c-a1d9-4168-8791-a9b1903cf185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d226d661-4024-4178-a087-399ed14d10dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:21 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Volume c1afa759-69a0-49a8-870a-87b65256ad7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1afa759-69a0-49a8-870a-87b65256ad7f', 'volume_size': 1} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1721163505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1afa759-69a0-49a8-870a-87b65256ad7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cd454f37dd494d877707f7b071aee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:59:21Z,use_quota=True,user_id='c485355aa52e47b580ae43bcfc4007a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Creating volume c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:59:21 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:21 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f 1073741824 Apr 27 23:59:21 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:21 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f 1073741824" returned: 0 in 0.591s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:21 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f Apr 27 23:59:21 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:22 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f" returned: 0 in 0.453s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:22 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:59:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d226d661-4024-4178-a087-399ed14d10dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1afa759-69a0-49a8-870a-87b65256ad7f', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d5009a-fb99-4bd0-a196-ed5e85ebc184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:22 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Volume volume-c1afa759-69a0-49a8-870a-87b65256ad7f (c1afa759-69a0-49a8-870a-87b65256ad7f): created successfully Apr 27 23:59:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d5009a-fb99-4bd0-a196-ed5e85ebc184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Flow 'volume_create_manager' (c6a75b8c-dfca-4b72-8e24-cdc674b9b407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:59:22 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cb7764e3-24c8-4501-95e1-7b093c3b90b1 tempest-VolumesDeleteCascade-879668648 None] Created volume successfully. Apr 27 23:59:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Creating offline snapshot e42bf84e-6d9c-48b4-840a-4ca15d685610 of volume c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:59:23 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad9aee-856c-46ea-9ffe-2116e3bdfd09]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:23 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f Apr 27 23:59:23 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:23 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f" returned: 0 in 0.503s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:23 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 1G Apr 27 23:59:23 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:24 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 1G" returned: 0 in 0.578s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1afa759-69a0-49a8-870a-87b65256ad7f -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:24 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1afa759-69a0-49a8-870a-87b65256ad7f -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 Apr 27 23:59:24 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:25 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1afa759-69a0-49a8-870a-87b65256ad7f -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610" returned: 0 in 0.477s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:25 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 is being set with open permissions: ugo+rw Apr 27 23:59:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:25 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 Apr 27 23:59:25 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:25 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610" returned: 0 in 0.431s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:25 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=109,cinder:INSERT=34,cinder:UPDATE=116,cinder:DELETE=8 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:59:25 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=102,cinder:INSERT=35,cinder:UPDATE=110,cinder:DELETE=7 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 27 23:59:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:25 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.info Apr 27 23:59:25 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:25 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.info" returned: 0 in 0.424s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:25 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.info is being set with open permissions: ugo+rw Apr 27 23:59:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:25 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.info Apr 27 23:59:25 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:26 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.info" returned: 0 in 0.417s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.930s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ef96aad2-dc84-404c-bb12-493c549758f8 tempest-VolumesDeleteCascade-879668648 None] Create snapshot completed successfully Apr 27 23:59:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Creating offline snapshot ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f of volume c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:59:26 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eafbfb-75e0-4240-835b-5cf7c6ac9136]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:26 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 Apr 27 23:59:26 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:27 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610" returned: 0 in 0.513s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:27 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1afa759-69a0-49a8-870a-87b65256ad7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:27 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f 1G Apr 27 23:59:27 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:27 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f 1G" returned: 0 in 0.611s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:27 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f Apr 27 23:59:27 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:28 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f" returned: 0 in 0.477s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:28 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f is being set with open permissions: ugo+rw Apr 27 23:59:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:28 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f Apr 27 23:59:28 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:28 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f" returned: 0 in 0.442s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:28 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-09ebcee3-19ee-4716-9541-91c5fa79e1e6 tempest-VolumesDeleteCascade-879668648 None] Create snapshot completed successfully Apr 27 23:59:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-c1afa759-69a0-49a8-870a-87b65256ad7f-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-c1afa759-69a0-49a8-870a-87b65256ad7f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Performing cascade delete. {{(pid=81312) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 27 23:59:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-c1afa759-69a0-49a8-870a-87b65256ad7f" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c1afa759-69a0-49a8-870a-87b65256ad7f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Deleting offline snapshot ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f of volume c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:59:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] snapshot_file for this snap is: volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:59:30 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7341d51d-dfce-4b4d-82d8-7cb19bf003aa]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:30 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f Apr 27 23:59:30 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:30 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f" returned: 0 in 0.512s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1afa759-69a0-49a8-870a-87b65256ad7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:30 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e491e1e-57da-4e64-a5db-14f40ec1c671]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:30 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 Apr 27 23:59:30 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:31 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610" returned: 0 in 0.520s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1afa759-69a0-49a8-870a-87b65256ad7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:31 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f Apr 27 23:59:31 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:31 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f" returned: 0 in 0.575s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:31 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f Apr 27 23:59:31 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:32 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f" returned: 0 in 0.445s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f" released by "_delete_snapshot" :: held 2.140s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c1afa759-69a0-49a8-870a-87b65256ad7f" released by "delete_snapshot" :: held 2.162s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Created reservations ['f16f181f-4c22-4c6c-9e9c-462a1ab456b2', '69d3ae3e-8110-4fea-be66-79f5ed5988c6', 'e982146f-fb2e-494a-86d8-53cb9024df0b', 'b80805e1-985d-4748-bbe5-8089100fb868'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:32 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Delete snapshot completed successfully. Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-ac391f6b-b85c-4a59-8f56-4a1e2f7ca29f-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-e42bf84e-6d9c-48b4-840a-4ca15d685610-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-e42bf84e-6d9c-48b4-840a-4ca15d685610-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-c1afa759-69a0-49a8-870a-87b65256ad7f" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c1afa759-69a0-49a8-870a-87b65256ad7f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-e42bf84e-6d9c-48b4-840a-4ca15d685610" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-e42bf84e-6d9c-48b4-840a-4ca15d685610" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Deleting offline snapshot e42bf84e-6d9c-48b4-840a-4ca15d685610 of volume c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] snapshot_file for this snap is: volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a9d235-c177-40a4-a947-e80cb5f45747]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:32 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 Apr 27 23:59:32 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:32 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610" returned: 0 in 0.500s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1afa759-69a0-49a8-870a-87b65256ad7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c9c0ee-cd22-4832-b5cd-45a351a8e263]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:32 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f Apr 27 23:59:32 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:33 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f" returned: 0 in 0.516s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:33 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 Apr 27 23:59:33 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:33 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610" returned: 0 in 0.523s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:33 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610 Apr 27 23:59:33 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:34 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f.e42bf84e-6d9c-48b4-840a-4ca15d685610" returned: 0 in 0.423s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-e42bf84e-6d9c-48b4-840a-4ca15d685610" released by "_delete_snapshot" :: held 2.056s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c1afa759-69a0-49a8-870a-87b65256ad7f" released by "delete_snapshot" :: held 2.081s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Created reservations ['3e0dfb1d-f403-45e5-a70a-81ef70649baa', '0f313b51-67d6-448b-8d7c-4bf68cc07270', '1e945387-109b-4bfc-a189-44360843eece', 'dc41ab5f-d9f7-4de4-b22c-2efd88065d57'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Delete snapshot completed successfully. Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-e42bf84e-6d9c-48b4-840a-4ca15d685610-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Snapshots deleted, issuing volume delete {{(pid=81312) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-c1afa759-69a0-49a8-870a-87b65256ad7f" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c1afa759-69a0-49a8-870a-87b65256ad7f" acquired by "delete_volume" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c671f9ea-d4c6-487a-b8e5-72c5e76b5d07]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:34 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f Apr 27 23:59:34 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:35 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f" returned: 0 in 0.489s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:35 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f Apr 27 23:59:35 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:35 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c1afa759-69a0-49a8-870a-87b65256ad7f" returned: 0 in 0.437s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c1afa759-69a0-49a8-870a-87b65256ad7f" released by "delete_volume" :: held 0.981s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Created reservations ['48881228-2f7b-4521-91e2-7b513d47e680', '8bef1978-336a-4123-bef7-e0ca5c515e19', '9868e058-c551-4dcc-a294-db798b8ab2e5', '07200c6d-d035-4837-ba02-78280a6d5c94'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:35 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:59:35 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:36 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:59:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Deleted volume successfully. Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-92cfe5cb-ad9e-49ad-9c29-4f702da6d3f7 tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-c1afa759-69a0-49a8-870a-87b65256ad7f-delete_volume" released by "delete_volume" :: held 6.151s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Flow 'volume_create_manager' (853f1ece-2111-4875-ba69-b1ee066c7fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3ff849-2370-47df-b8bc-ffdba81607c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3ff849-2370-47df-b8bc-ffdba81607c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1985640251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6badc9d2-8094-4d11-81a0-d60058b6b20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cd454f37dd494d877707f7b071aee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:59:37Z,use_quota=True,user_id='c485355aa52e47b580ae43bcfc4007a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ec5b7b-cc75-4536-97e4-333103ed0268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ec5b7b-cc75-4536-97e4-333103ed0268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1599205e-891a-454e-9926-bfe64f44906b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1599205e-891a-454e-9926-bfe64f44906b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6badc9d2-8094-4d11-81a0-d60058b6b20e', 'volume_name': 'volume-6badc9d2-8094-4d11-81a0-d60058b6b20e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f02e7a-f0a9-4d9b-a75f-9e426bde358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f02e7a-f0a9-4d9b-a75f-9e426bde358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078c7040-8a3a-409b-8c0c-c5d7bf467237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:36 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Volume 6badc9d2-8094-4d11-81a0-d60058b6b20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6badc9d2-8094-4d11-81a0-d60058b6b20e', 'volume_size': 1} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1985640251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6badc9d2-8094-4d11-81a0-d60058b6b20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cd454f37dd494d877707f7b071aee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:59:37Z,use_quota=True,user_id='c485355aa52e47b580ae43bcfc4007a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Creating volume 6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:59:36 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 27 23:59:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:36 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e 1073741824 Apr 27 23:59:36 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:37 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e 1073741824" returned: 0 in 0.588s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:37 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e Apr 27 23:59:37 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:37 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e" returned: 0 in 0.443s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 27 23:59:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078c7040-8a3a-409b-8c0c-c5d7bf467237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6badc9d2-8094-4d11-81a0-d60058b6b20e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dc42b0-ad0e-4211-933e-5309f1f79e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:37 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Volume volume-6badc9d2-8094-4d11-81a0-d60058b6b20e (6badc9d2-8094-4d11-81a0-d60058b6b20e): created successfully Apr 27 23:59:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dc42b0-ad0e-4211-933e-5309f1f79e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Flow 'volume_create_manager' (853f1ece-2111-4875-ba69-b1ee066c7fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:59:37 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b78a7fa7-e24e-45de-943c-549441f67157 tempest-VolumesDeleteCascade-879668648 None] Created volume successfully. Apr 27 23:59:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Creating offline snapshot fa6e0ae3-5d37-4679-83fa-77400238251f of volume 6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 27 23:59:39 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc184f-5834-4f3c-964b-95231d858743]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:39 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e Apr 27 23:59:39 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:39 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e" returned: 0 in 0.512s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:39 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f 1G Apr 27 23:59:39 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:40 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f 1G" returned: 0 in 0.575s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6badc9d2-8094-4d11-81a0-d60058b6b20e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:40 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6badc9d2-8094-4d11-81a0-d60058b6b20e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f Apr 27 23:59:40 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:40 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6badc9d2-8094-4d11-81a0-d60058b6b20e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f" returned: 0 in 0.464s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:40 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f is being set with open permissions: ugo+rw Apr 27 23:59:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:40 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f Apr 27 23:59:40 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:41 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:41 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.info Apr 27 23:59:41 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:41 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.info" returned: 0 in 0.447s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:41 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.info is being set with open permissions: ugo+rw Apr 27 23:59:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:41 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.info Apr 27 23:59:41 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:42 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.info" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:42 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-316a0158-1255-45bf-b06c-1d627907a50c tempest-VolumesDeleteCascade-879668648 None] Create snapshot completed successfully Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Flow 'volume_create_manager' (a5930042-945d-4c55-bd05-57e5847a18a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbce20e-cd59-410d-b418-3a99c6cb97a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbce20e-cd59-410d-b418-3a99c6cb97a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T21:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2009593343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c936c909-5ff9-4606-b376-617cb6af1eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cd454f37dd494d877707f7b071aee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T21:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa6e0ae3-5d37-4679-83fa-77400238251f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T21:59:42Z,use_quota=True,user_id='c485355aa52e47b580ae43bcfc4007a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4834e3-327a-4652-9ff5-803320f6e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4834e3-327a-4652-9ff5-803320f6e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46728587-a1a5-490c-bb3e-96d307fe2866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46728587-a1a5-490c-bb3e-96d307fe2866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c936c909-5ff9-4606-b376-617cb6af1eb6', 'volume_name': 'volume-c936c909-5ff9-4606-b376-617cb6af1eb6', 'volume_size': 1, 'snapshot_id': 'fa6e0ae3-5d37-4679-83fa-77400238251f'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f42164c-f239-4fe3-aea5-4611cbb05e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f42164c-f239-4fe3-aea5-4611cbb05e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee80efd-aca2-4456-813d-151b58015a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:42 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Volume c936c909-5ff9-4606-b376-617cb6af1eb6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c936c909-5ff9-4606-b376-617cb6af1eb6', 'volume_size': 1, 'snapshot_id': 'fa6e0ae3-5d37-4679-83fa-77400238251f'} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-fa6e0ae3-5d37-4679-83fa-77400238251f-c936c909-5ff9-4606-b376-617cb6af1eb6" by "_create_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-fa6e0ae3-5d37-4679-83fa-77400238251f-c936c909-5ff9-4606-b376-617cb6af1eb6" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Creating volume c936c909-5ff9-4606-b376-617cb6af1eb6 from snapshot fa6e0ae3-5d37-4679-83fa-77400238251f {{(pid=81312) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-c936c909-5ff9-4606-b376-617cb6af1eb6" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c936c909-5ff9-4606-b376-617cb6af1eb6" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] snapshot: fa6e0ae3-5d37-4679-83fa-77400238251f, volume: c936c909-5ff9-4606-b376-617cb6af1eb6, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b4b588-b5f8-48a9-9bf9-8a108614ef2d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:42 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f Apr 27 23:59:42 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:43 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6badc9d2-8094-4d11-81a0-d60058b6b20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 27 23:59:43 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 27 23:59:43 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[71280b4c-f0d0-439e-a37f-e87eadeac2d3]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:43 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e Apr 27 23:59:43 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:43 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e" returned: 0 in 0.506s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:43 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 27 23:59:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:43 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 Apr 27 23:59:43 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 27 23:59:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:45 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:59:45 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:45 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.788s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:59:48 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6" returned: 0 in 4.542s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:48 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5009d5-ea32-4fca-9e1d-63b2349ed03e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:48 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e Apr 27 23:59:48 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:48 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e" returned: 0 in 0.651s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:48 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 27 23:59:48 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Converted 1024.00 MB image at 225.39 MB/s Apr 27 23:59:48 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 is being set with open permissions: ugo+rw Apr 27 23:59:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:48 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 Apr 27 23:59:48 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:49 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6" returned: 0 in 0.421s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c936c909-5ff9-4606-b376-617cb6af1eb6" released by "_copy_volume_from_snapshot" :: held 6.736s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-fa6e0ae3-5d37-4679-83fa-77400238251f-c936c909-5ff9-4606-b376-617cb6af1eb6" released by "_create_volume_from_snapshot" :: held 6.764s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.778s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee80efd-aca2-4456-813d-151b58015a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c936c909-5ff9-4606-b376-617cb6af1eb6', 'volume_size': 1, 'snapshot_id': 'fa6e0ae3-5d37-4679-83fa-77400238251f'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8e8b5c-2a9b-4d88-9757-6d31f2a8c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 27 23:59:49 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Volume volume-c936c909-5ff9-4606-b376-617cb6af1eb6 (c936c909-5ff9-4606-b376-617cb6af1eb6): created successfully Apr 27 23:59:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8e8b5c-2a9b-4d88-9757-6d31f2a8c01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 27 23:59:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Flow 'volume_create_manager' (a5930042-945d-4c55-bd05-57e5847a18a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 27 23:59:49 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-8d0d2958-eb08-4c70-b2e7-6aa8084de6be tempest-VolumesDeleteCascade-879668648 None] Created volume successfully. Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-6badc9d2-8094-4d11-81a0-d60058b6b20e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-6badc9d2-8094-4d11-81a0-d60058b6b20e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Performing cascade delete. {{(pid=81312) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-fa6e0ae3-5d37-4679-83fa-77400238251f-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-fa6e0ae3-5d37-4679-83fa-77400238251f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-6badc9d2-8094-4d11-81a0-d60058b6b20e" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-6badc9d2-8094-4d11-81a0-d60058b6b20e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-fa6e0ae3-5d37-4679-83fa-77400238251f" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-fa6e0ae3-5d37-4679-83fa-77400238251f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Deleting offline snapshot fa6e0ae3-5d37-4679-83fa-77400238251f of volume 6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] snapshot_file for this snap is: volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[508b3809-1779-4800-804d-7dd66961841d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:50 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f Apr 27 23:59:50 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:50 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f" returned: 0 in 0.494s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6badc9d2-8094-4d11-81a0-d60058b6b20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b5ba1-0211-4a47-adca-5a86af319a59]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:50 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e Apr 27 23:59:50 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:51 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:51 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f Apr 27 23:59:51 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:51 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f" returned: 0 in 0.537s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:51 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f Apr 27 23:59:51 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:52 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e.fa6e0ae3-5d37-4679-83fa-77400238251f" returned: 0 in 0.422s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-fa6e0ae3-5d37-4679-83fa-77400238251f" released by "_delete_snapshot" :: held 2.058s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-6badc9d2-8094-4d11-81a0-d60058b6b20e" released by "delete_snapshot" :: held 2.081s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Created reservations ['a9e55f63-b2e9-4516-b49a-2e297c7fd315', '04606977-c2d9-489f-9491-bd316a13fef8', 'ccb61581-5570-4c86-8061-9a8dd8e34cb0', '3eb217bf-a2f8-4e38-95a8-491cf04f50b5'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:52 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Delete snapshot completed successfully. Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-fa6e0ae3-5d37-4679-83fa-77400238251f-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Snapshots deleted, issuing volume delete {{(pid=81312) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-6badc9d2-8094-4d11-81a0-d60058b6b20e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-6badc9d2-8094-4d11-81a0-d60058b6b20e" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f041110-380c-48fe-bf45-842c5dde353a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:52 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e Apr 27 23:59:52 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:53 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e" returned: 0 in 0.526s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:53 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e Apr 27 23:59:53 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:53 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-6badc9d2-8094-4d11-81a0-d60058b6b20e" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-6badc9d2-8094-4d11-81a0-d60058b6b20e" released by "delete_volume" :: held 1.018s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Created reservations ['04724f97-0673-4ac2-84f0-6dd7d1f6ec14', '43339fb1-925d-4734-ac79-5af9dd9ac53a', '31a6fa40-dfdb-4fe8-9501-8bfebe52b8b5', 'f8551f7b-f623-436c-910e-f92cc2a41ecc'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:53 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:59:53 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:54 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.422s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:54 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:59:54 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Deleted volume successfully. Apr 27 23:59:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1f0eed79-5043-442d-896f-1576df36a5ba tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-6badc9d2-8094-4d11-81a0-d60058b6b20e-delete_volume" released by "delete_volume" :: held 3.882s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-c936c909-5ff9-4606-b376-617cb6af1eb6-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-c936c909-5ff9-4606-b376-617cb6af1eb6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "cinder-quobyte-c936c909-5ff9-4606-b376-617cb6af1eb6" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 27 23:59:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c936c909-5ff9-4606-b376-617cb6af1eb6" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 27 23:59:54 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5823bbe1-2110-4463-aeb1-0069f7ed7e30]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 27 23:59:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:54 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 Apr 27 23:59:54 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:55 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6" returned: 0 in 0.498s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:55 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6 Apr 27 23:59:55 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:55 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c936c909-5ff9-4606-b376-617cb6af1eb6" returned: 0 in 0.421s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-quobyte-c936c909-5ff9-4606-b376-617cb6af1eb6" released by "delete_volume" :: held 0.958s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Created reservations ['c3f974d3-2004-4033-9665-b80ee74346be', 'b967ea80-86a4-4387-9065-98c51c815924', '7f6fbbd4-b6ec-4cb9-86af-ea5f5d050a78', '736a5e3c-794b-4542-b188-b745be2ec5ec'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 27 23:59:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 27 23:59:55 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 27 23:59:55 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 27 23:59:56 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 27 23:59:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.428s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 27 23:59:56 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 27 23:59:56 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Deleted volume successfully. Apr 27 23:59:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b4f5a883-bee0-44fa-8172-5f91076bc9ac tempest-VolumesDeleteCascade-879668648 None] Lock "cinder-c936c909-5ff9-4606-b376-617cb6af1eb6-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Flow 'volume_create_manager' (c3950722-7f83-4abb-84f0-e851e084ebd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f2c041-2510-4b26-8804-f7b5e7bd52c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f2c041-2510-4b26-8804-f7b5e7bd52c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-491647819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7b5b83-bbec-4ace-9098-8532c6983a63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c9eace03b60476ea8997ece2dd59583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:00:02Z,use_quota=True,user_id='9d9a9dacc238441288a1266436dde479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e6e243-a042-45a4-83f3-c3d353fb595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e6e243-a042-45a4-83f3-c3d353fb595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df322ec-3784-4a4e-96fd-f7f9d161ba3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df322ec-3784-4a4e-96fd-f7f9d161ba3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7b5b83-bbec-4ace-9098-8532c6983a63', 'volume_name': 'volume-2d7b5b83-bbec-4ace-9098-8532c6983a63', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5a29a4-5ec1-48cb-8939-2cdf8cc3b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5a29a4-5ec1-48cb-8939-2cdf8cc3b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b58a62-49f1-43f4-8060-1427debf0a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:01 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Volume 2d7b5b83-bbec-4ace-9098-8532c6983a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7b5b83-bbec-4ace-9098-8532c6983a63', 'volume_size': 1} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-491647819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7b5b83-bbec-4ace-9098-8532c6983a63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c9eace03b60476ea8997ece2dd59583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:00:02Z,use_quota=True,user_id='9d9a9dacc238441288a1266436dde479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Creating volume 2d7b5b83-bbec-4ace-9098-8532c6983a63 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:00:01 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:00:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:01 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 1073741824 Apr 28 00:00:01 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:02 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 1073741824" returned: 0 in 0.589s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:02 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 Apr 28 00:00:02 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:02 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63" returned: 0 in 0.441s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:00:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b58a62-49f1-43f4-8060-1427debf0a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7b5b83-bbec-4ace-9098-8532c6983a63', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2625218e-4bd4-4c36-b254-c31d47d042f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:02 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Volume volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 (2d7b5b83-bbec-4ace-9098-8532c6983a63): created successfully Apr 28 00:00:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2625218e-4bd4-4c36-b254-c31d47d042f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Flow 'volume_create_manager' (c3950722-7f83-4abb-84f0-e851e084ebd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:00:02 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6a4cc820-2c44-44ec-aec1-e0de7ab10c51 tempest-VolumesListTestJSON-918247998 None] Created volume successfully. Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Flow 'volume_create_manager' (f6c9c99e-9347-4aa8-bd61-7fc547137edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d80a0b-3486-4f53-8823-c42a9b1eae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d80a0b-3486-4f53-8823-c42a9b1eae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1113010891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40c1e5f-e8ce-4270-a2bb-08ba5417206e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c9eace03b60476ea8997ece2dd59583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:00:04Z,use_quota=True,user_id='9d9a9dacc238441288a1266436dde479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bb9af1-294c-4c23-8843-98cf71f7cfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bb9af1-294c-4c23-8843-98cf71f7cfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee71d0ff-5089-4a58-9350-8f3c9b410019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee71d0ff-5089-4a58-9350-8f3c9b410019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f40c1e5f-e8ce-4270-a2bb-08ba5417206e', 'volume_name': 'volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bf9e90-015b-40c9-983f-3f41b1d736ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bf9e90-015b-40c9-983f-3f41b1d736ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055dc30e-7fd6-4c47-b0e7-6507ce5006cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:04 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Volume f40c1e5f-e8ce-4270-a2bb-08ba5417206e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e', 'volume_size': 1} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1113010891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40c1e5f-e8ce-4270-a2bb-08ba5417206e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c9eace03b60476ea8997ece2dd59583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:00:04Z,use_quota=True,user_id='9d9a9dacc238441288a1266436dde479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Creating volume f40c1e5f-e8ce-4270-a2bb-08ba5417206e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:00:04 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:04 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e 1073741824 Apr 28 00:00:04 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:04 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e 1073741824" returned: 0 in 0.591s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:04 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e Apr 28 00:00:04 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:05 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e" returned: 0 in 0.452s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:00:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055dc30e-7fd6-4c47-b0e7-6507ce5006cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11a93b1-e8cb-481d-be7e-b2ad763e4975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:05 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Volume volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e (f40c1e5f-e8ce-4270-a2bb-08ba5417206e): created successfully Apr 28 00:00:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11a93b1-e8cb-481d-be7e-b2ad763e4975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Flow 'volume_create_manager' (f6c9c99e-9347-4aa8-bd61-7fc547137edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:00:05 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-60804d46-5847-45d2-a318-1f2bd94e7ad5 tempest-VolumesListTestJSON-918247998 None] Created volume successfully. Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Flow 'volume_create_manager' (470b891e-acb1-4050-9f0d-e34d6c391704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68f5828-8cc9-402d-9ea0-0b5bfa8fcbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68f5828-8cc9-402d-9ea0-0b5bfa8fcbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-621519532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6fa673-cfb1-47a4-9c3c-4a201e107b54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c9eace03b60476ea8997ece2dd59583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:00:06Z,use_quota=True,user_id='9d9a9dacc238441288a1266436dde479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b314acc-2d8a-4671-a8d7-931caaa5842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b314acc-2d8a-4671-a8d7-931caaa5842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5338b292-6b0f-4d22-aa62-114ec60b3403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5338b292-6b0f-4d22-aa62-114ec60b3403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6fa673-cfb1-47a4-9c3c-4a201e107b54', 'volume_name': 'volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb7667c-4e8b-4157-8272-99b15b9d2d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb7667c-4e8b-4157-8272-99b15b9d2d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb6e7ca-dc8e-48dd-a81a-1f076d313834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:06 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Volume fa6fa673-cfb1-47a4-9c3c-4a201e107b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54', 'volume_size': 1} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-621519532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6fa673-cfb1-47a4-9c3c-4a201e107b54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c9eace03b60476ea8997ece2dd59583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:00:06Z,use_quota=True,user_id='9d9a9dacc238441288a1266436dde479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Creating volume fa6fa673-cfb1-47a4-9c3c-4a201e107b54 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:00:06 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:00:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:06 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 1073741824 Apr 28 00:00:06 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:07 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 1073741824" returned: 0 in 0.629s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:07 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 Apr 28 00:00:07 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:07 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54" returned: 0 in 0.434s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:00:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb6e7ca-dc8e-48dd-a81a-1f076d313834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ba8661-324c-4578-9f15-7ff1f0514811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:07 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Volume volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 (fa6fa673-cfb1-47a4-9c3c-4a201e107b54): created successfully Apr 28 00:00:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ba8661-324c-4578-9f15-7ff1f0514811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Flow 'volume_create_manager' (470b891e-acb1-4050-9f0d-e34d6c391704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:00:07 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3302722c-8376-4f08-80e3-10aa2ef86baa tempest-VolumesListTestJSON-918247998 None] Created volume successfully. Apr 28 00:00:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "cinder-fa6fa673-cfb1-47a4-9c3c-4a201e107b54-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:00:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Lock "cinder-fa6fa673-cfb1-47a4-9c3c-4a201e107b54-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:00:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "cinder-quobyte-fa6fa673-cfb1-47a4-9c3c-4a201e107b54" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:00:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Lock "cinder-quobyte-fa6fa673-cfb1-47a4-9c3c-4a201e107b54" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:00:11 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1a663f-cb84-4f55-ba8a-6e7117db63bf]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:00:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:11 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 Apr 28 00:00:11 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:11 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54" returned: 0 in 0.512s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:11 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54 Apr 28 00:00:11 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:12 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-fa6fa673-cfb1-47a4-9c3c-4a201e107b54" returned: 0 in 0.477s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Lock "cinder-quobyte-fa6fa673-cfb1-47a4-9c3c-4a201e107b54" released by "delete_volume" :: held 1.037s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Created reservations ['fcf3852d-2ef4-48be-9242-f5a509e7ea6f', '05270e6e-8b21-4b3c-bcc5-ae0cb111d9c4', 'adca14ad-a99b-4414-ac09-b2dcb0ea4c3e', '32d76abb-7ae8-4159-8590-631989bb48e7'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:12 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:00:12 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:12 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.503s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:00:12 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Deleted volume successfully. Apr 28 00:00:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5675fbd2-8c76-44a8-8316-f0dea6b088e3 tempest-VolumesListTestJSON-918247998 None] Lock "cinder-fa6fa673-cfb1-47a4-9c3c-4a201e107b54-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:00:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "cinder-f40c1e5f-e8ce-4270-a2bb-08ba5417206e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:00:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Lock "cinder-f40c1e5f-e8ce-4270-a2bb-08ba5417206e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:00:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "cinder-quobyte-f40c1e5f-e8ce-4270-a2bb-08ba5417206e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:00:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Lock "cinder-quobyte-f40c1e5f-e8ce-4270-a2bb-08ba5417206e" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:00:13 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c044bf3-e57c-4e5d-8db6-53eab05c3dff]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:00:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:13 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e Apr 28 00:00:13 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:13 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e" returned: 0 in 0.513s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:13 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e Apr 28 00:00:13 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:14 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f40c1e5f-e8ce-4270-a2bb-08ba5417206e" returned: 0 in 0.457s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Lock "cinder-quobyte-f40c1e5f-e8ce-4270-a2bb-08ba5417206e" released by "delete_volume" :: held 1.011s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:00:14 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Created reservations ['eb83200d-f838-42e4-bfc8-9165dcccff50', '9bf09691-279e-4fc8-b84f-12d637f414f9', '9c5df3ed-fbcb-4f20-a95d-c0b51d6c86b7', 'f5526d15-3746-4ec3-81c0-ebf86287688f'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:00:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:00:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:00:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:14 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:00:14 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:15 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.476s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:15 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:00:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Deleted volume successfully. Apr 28 00:00:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0dfb2d3c-c786-4540-8de1-d6e16fb54539 tempest-VolumesListTestJSON-918247998 None] Lock "cinder-f40c1e5f-e8ce-4270-a2bb-08ba5417206e-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:00:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Acquiring lock "cinder-2d7b5b83-bbec-4ace-9098-8532c6983a63-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:00:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Lock "cinder-2d7b5b83-bbec-4ace-9098-8532c6983a63-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:00:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Acquiring lock "cinder-quobyte-2d7b5b83-bbec-4ace-9098-8532c6983a63" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:00:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Lock "cinder-quobyte-2d7b5b83-bbec-4ace-9098-8532c6983a63" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:00:15 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[afca3d11-ee05-44cb-b670-b55ad783f488]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:00:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:15 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 Apr 28 00:00:15 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:16 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63" returned: 0 in 0.502s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:16 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63 Apr 28 00:00:16 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:16 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2d7b5b83-bbec-4ace-9098-8532c6983a63" returned: 0 in 0.470s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Lock "cinder-quobyte-2d7b5b83-bbec-4ace-9098-8532c6983a63" released by "delete_volume" :: held 1.018s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Created reservations ['9aae3c70-f805-4845-9d69-f2e440df5433', '679d652c-806e-4121-83ca-05485e3dd731', '21903209-ff6f-442a-84db-879877314d2b', '18a370ae-efed-4fde-b9aa-32b676bdbfa9'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:16 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:00:16 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:17 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.411s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:17 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:00:17 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Deleted volume successfully. Apr 28 00:00:17 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2c3047f-4fa2-4d28-a6f7-bfa2a550d53f tempest-VolumesListTestJSON-918247998 None] Lock "cinder-2d7b5b83-bbec-4ace-9098-8532c6983a63-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Flow 'volume_create_manager' (647aa4bc-b4be-42c9-b687-bf398f34e8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c95e12-343d-4bae-a9d0-52752c6550d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c95e12-343d-4bae-a9d0-52752c6550d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-997918599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfe074f-d8e2-419d-b6aa-c24d2bf99107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170e6bcf3be84a68968b01c42696ad91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:00:20Z,use_quota=True,user_id='2db55003af954a1a9f01e479b03da0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bceb175d-18bb-4fad-bf87-9c6a9374c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bceb175d-18bb-4fad-bf87-9c6a9374c83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdafb9f4-62c5-4202-92e3-ee85fd6a637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdafb9f4-62c5-4202-92e3-ee85fd6a637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dfe074f-d8e2-419d-b6aa-c24d2bf99107', 'volume_name': 'volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7cf47e-85af-41ea-b55c-50496b6abccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7cf47e-85af-41ea-b55c-50496b6abccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d690e350-15bc-4ac5-b13b-a011f3bad08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:20 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Volume 4dfe074f-d8e2-419d-b6aa-c24d2bf99107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107', 'volume_size': 1} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-997918599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfe074f-d8e2-419d-b6aa-c24d2bf99107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170e6bcf3be84a68968b01c42696ad91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:00:20Z,use_quota=True,user_id='2db55003af954a1a9f01e479b03da0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Creating volume 4dfe074f-d8e2-419d-b6aa-c24d2bf99107 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:00:20 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:00:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:20 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 1073741824 Apr 28 00:00:20 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:21 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 1073741824" returned: 0 in 0.624s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:21 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 Apr 28 00:00:21 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:21 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107" returned: 0 in 0.441s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:00:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d690e350-15bc-4ac5-b13b-a011f3bad08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b480631-1b80-4522-b4a0-dee77eb67701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:00:21 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Volume volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 (4dfe074f-d8e2-419d-b6aa-c24d2bf99107): created successfully Apr 28 00:00:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b480631-1b80-4522-b4a0-dee77eb67701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:00:21 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Flow 'volume_create_manager' (647aa4bc-b4be-42c9-b687-bf398f34e8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:00:21 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-39b45733-c232-4503-bb6b-e790f8c711b6 tempest-VolumesNegativeTest-661521815 None] Created volume successfully. Apr 28 00:00:31 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=71,cinder:UPDATE=79,cinder:INSERT=19,cinder:DELETE=8 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:00:31 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=61,cinder:DELETE=7,cinder:UPDATE=91,cinder:INSERT=24 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:00:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 00:00:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:00:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:00:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:45 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:00:45 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:45 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.427s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:00:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Acquiring lock "cinder-4dfe074f-d8e2-419d-b6aa-c24d2bf99107-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:00:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Lock "cinder-4dfe074f-d8e2-419d-b6aa-c24d2bf99107-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:00:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Acquiring lock "cinder-quobyte-4dfe074f-d8e2-419d-b6aa-c24d2bf99107" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:00:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Lock "cinder-quobyte-4dfe074f-d8e2-419d-b6aa-c24d2bf99107" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:00:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd937ff0-9515-403c-a690-d3902e4d7ec0]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:00:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:51 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 Apr 28 00:00:51 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:51 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:51 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107 Apr 28 00:00:51 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:52 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-4dfe074f-d8e2-419d-b6aa-c24d2bf99107" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Lock "cinder-quobyte-4dfe074f-d8e2-419d-b6aa-c24d2bf99107" released by "delete_volume" :: held 0.988s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Created reservations ['768604ad-9c34-418e-9ee0-88fb1a671a31', '9ec82bcc-2a7b-4666-8811-da3739026feb', '3b7b48fa-907c-42ee-93e6-c0acb58e2c67', '05c89fea-8dea-4468-b122-57222670ee08'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:00:52 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:00:52 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:00:52 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:00:52 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Deleted volume successfully. Apr 28 00:00:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-889d3f4e-5cdd-4e2b-aedf-8b9616a400e5 tempest-VolumesNegativeTest-661521815 None] Lock "cinder-4dfe074f-d8e2-419d-b6aa-c24d2bf99107-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:02 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:01:02 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (16e1ac1a-c11a-4f45-b11f-707de03a28da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd893877-e0db-4f4b-80b2-12e37d57ec93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd893877-e0db-4f4b-80b2-12e37d57ec93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-946039921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ed9cec-536b-4cc7-836d-c0fe5d18b94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26233c4bdc4744db95ddc5d7d775df32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:01:04Z,use_quota=True,user_id='d67e0865950e493abe218a129b969bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fce5de3-bcbd-4f0f-bc31-02c65daf907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fce5de3-bcbd-4f0f-bc31-02c65daf907c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338bcf0b-2b3e-4f31-b2c4-799e2edf4867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338bcf0b-2b3e-4f31-b2c4-799e2edf4867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ed9cec-536b-4cc7-836d-c0fe5d18b94c', 'volume_name': 'volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27db5f5a-868d-4ae1-92b8-01fe50e22752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27db5f5a-868d-4ae1-92b8-01fe50e22752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ee57bd-19f9-4374-a422-16e6a96aac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:03 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Volume 67ed9cec-536b-4cc7-836d-c0fe5d18b94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c', 'volume_size': 1} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-946039921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ed9cec-536b-4cc7-836d-c0fe5d18b94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26233c4bdc4744db95ddc5d7d775df32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:01:04Z,use_quota=True,user_id='d67e0865950e493abe218a129b969bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Creating volume 67ed9cec-536b-4cc7-836d-c0fe5d18b94c {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:01:03 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:01:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:03 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c 1073741824 Apr 28 00:01:03 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:04 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c 1073741824" returned: 0 in 0.593s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:04 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c Apr 28 00:01:04 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:04 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" returned: 0 in 0.435s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:01:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ee57bd-19f9-4374-a422-16e6a96aac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a03e27-86b7-4d80-8b04-b4f36d618395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:05 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Volume volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c (67ed9cec-536b-4cc7-836d-c0fe5d18b94c): created successfully Apr 28 00:01:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a03e27-86b7-4d80-8b04-b4f36d618395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (16e1ac1a-c11a-4f45-b11f-707de03a28da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:05 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-822509c6-f7ba-4c53-b97e-df7afe39aed1 tempest-VolumesSnapshotTestJSON-102696425 None] Created volume successfully. Apr 28 00:01:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Creating offline snapshot d145447a-8f97-4438-8a59-564820859ca0 of volume 67ed9cec-536b-4cc7-836d-c0fe5d18b94c {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:01:06 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59255d3-4ac4-45d3-8c72-7ec44ec6adb9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:06 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c Apr 28 00:01:06 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:06 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" returned: 0 in 0.510s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:06 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 1G Apr 28 00:01:06 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:07 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 1G" returned: 0 in 0.592s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:07 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 Apr 28 00:01:07 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:07 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0" returned: 0 in 0.478s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:07 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 is being set with open permissions: ugo+rw Apr 28 00:01:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:07 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 Apr 28 00:01:07 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:08 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0" returned: 0 in 0.431s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:08 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.info Apr 28 00:01:08 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:08 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.info" returned: 0 in 0.461s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:08 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.info is being set with open permissions: ugo+rw Apr 28 00:01:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:08 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.info Apr 28 00:01:08 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:09 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.info" returned: 0 in 0.446s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:09 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3fb5e1ae-0fc5-4601-b4ad-e47251c7b9e3 tempest-VolumesSnapshotTestJSON-102696425 None] Create snapshot completed successfully Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-d145447a-8f97-4438-8a59-564820859ca0-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-d145447a-8f97-4438-8a59-564820859ca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-d145447a-8f97-4438-8a59-564820859ca0" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-d145447a-8f97-4438-8a59-564820859ca0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Deleting offline snapshot d145447a-8f97-4438-8a59-564820859ca0 of volume 67ed9cec-536b-4cc7-836d-c0fe5d18b94c {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] snapshot_file for this snap is: volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[638315e9-c85e-4267-8c8b-28e54700c0ad]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:10 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 Apr 28 00:01:10 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:11 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0" returned: 0 in 0.531s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:01:11 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4706c0-13bf-4c97-8dee-6f729958fea8]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:11 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c Apr 28 00:01:11 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:11 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" returned: 0 in 0.519s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:11 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 Apr 28 00:01:11 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:12 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0" returned: 0 in 0.569s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:12 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0 Apr 28 00:01:12 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:12 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c.d145447a-8f97-4438-8a59-564820859ca0" returned: 0 in 0.425s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-d145447a-8f97-4438-8a59-564820859ca0" released by "_delete_snapshot" :: held 2.143s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" released by "delete_snapshot" :: held 2.167s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:12 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Created reservations ['3c13f175-7a42-45a4-8497-594172a6c5ef', '1626d761-f87b-4744-b82e-8952c94cf6ba', 'fea4b707-199d-4295-8524-4e27b2cf82ca', 'a32d0c00-6e01-4a7d-91dd-e6720fcd414a'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:01:12 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Delete snapshot completed successfully. Apr 28 00:01:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-301d21d6-7e36-4649-b9ea-0bc35e50e0e4 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-d145447a-8f97-4438-8a59-564820859ca0-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (d3d22174-924d-4372-b550-2f1ee9332ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2da28-62b6-4787-b423-e80a4e83b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2da28-62b6-4787-b423-e80a4e83b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-774513769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8766bfaa-5993-49a5-9c72-fd60c17a2584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26233c4bdc4744db95ddc5d7d775df32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:01:14Z,use_quota=True,user_id='d67e0865950e493abe218a129b969bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c05c73-ffe3-4dad-af5a-cb04c7c99eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c05c73-ffe3-4dad-af5a-cb04c7c99eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33330d69-08cb-4379-af72-ce352a2df4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33330d69-08cb-4379-af72-ce352a2df4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8766bfaa-5993-49a5-9c72-fd60c17a2584', 'volume_name': 'volume-8766bfaa-5993-49a5-9c72-fd60c17a2584', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f532eb0-8c44-49be-b563-ebb74844969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f532eb0-8c44-49be-b563-ebb74844969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cdded4-2398-4d1c-bec0-22b74a0746c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:14 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Volume 8766bfaa-5993-49a5-9c72-fd60c17a2584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8766bfaa-5993-49a5-9c72-fd60c17a2584', 'volume_size': 1} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-774513769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8766bfaa-5993-49a5-9c72-fd60c17a2584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26233c4bdc4744db95ddc5d7d775df32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:01:14Z,use_quota=True,user_id='d67e0865950e493abe218a129b969bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Creating volume 8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:01:14 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:14 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 1073741824 Apr 28 00:01:14 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:14 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 1073741824" returned: 0 in 0.589s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:14 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 Apr 28 00:01:14 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:15 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584" returned: 0 in 0.445s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:01:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cdded4-2398-4d1c-bec0-22b74a0746c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8766bfaa-5993-49a5-9c72-fd60c17a2584', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e6d615-f81d-4ca0-a7ab-f1a7d09ecd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:15 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Volume volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 (8766bfaa-5993-49a5-9c72-fd60c17a2584): created successfully Apr 28 00:01:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e6d615-f81d-4ca0-a7ab-f1a7d09ecd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:15 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (d3d22174-924d-4372-b550-2f1ee9332ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d64234d0-f779-447f-a84f-3b600bc0a572 tempest-VolumesSnapshotTestJSON-102696425 None] Created volume successfully. Apr 28 00:01:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:16 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Creating offline snapshot d183ccbc-65b3-4d24-8b6e-f05375a1076e of volume 8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:01:16 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[349de7a8-e769-4283-9a1c-5c5e649f8ce5]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:16 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 Apr 28 00:01:16 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:16 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584" returned: 0 in 0.506s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:16 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e 1G Apr 28 00:01:16 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:17 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e 1G" returned: 0 in 0.584s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:17 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e Apr 28 00:01:17 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:17 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e" returned: 0 in 0.470s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:17 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e is being set with open permissions: ugo+rw Apr 28 00:01:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:17 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e Apr 28 00:01:17 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:18 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e" returned: 0 in 0.463s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:18 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.info Apr 28 00:01:18 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:18 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.info" returned: 0 in 0.450s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:18 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.info is being set with open permissions: ugo+rw Apr 28 00:01:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:18 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.info Apr 28 00:01:18 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:19 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.info" returned: 0 in 0.427s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.986s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:19 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0c6af4e0-36aa-4dd6-8f6b-b420fe89ab45 tempest-VolumesSnapshotTestJSON-102696425 None] Create snapshot completed successfully Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (bca16d6a-d9b7-402e-b202-b06269790d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa97f350-1a34-4f7a-959d-71f7d039c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa97f350-1a34-4f7a-959d-71f7d039c452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1384836829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ced740-af5b-4bf5-a650-4e9429d0cc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26233c4bdc4744db95ddc5d7d775df32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:01:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d183ccbc-65b3-4d24-8b6e-f05375a1076e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:01:20Z,use_quota=True,user_id='d67e0865950e493abe218a129b969bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7945e569-9209-4a77-bb00-14219962c616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7945e569-9209-4a77-bb00-14219962c616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50968b34-e89e-449e-b482-05b55d2cd943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50968b34-e89e-449e-b482-05b55d2cd943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13ced740-af5b-4bf5-a650-4e9429d0cc91', 'volume_name': 'volume-13ced740-af5b-4bf5-a650-4e9429d0cc91', 'volume_size': 2, 'snapshot_id': 'd183ccbc-65b3-4d24-8b6e-f05375a1076e'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffe1218-f51a-4078-a5de-d1b3757e6df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ffe1218-f51a-4078-a5de-d1b3757e6df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d2be64-57ab-4dc2-9fed-5f22210e8ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:19 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Volume 13ced740-af5b-4bf5-a650-4e9429d0cc91: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13ced740-af5b-4bf5-a650-4e9429d0cc91', 'volume_size': 2, 'snapshot_id': 'd183ccbc-65b3-4d24-8b6e-f05375a1076e'} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-d183ccbc-65b3-4d24-8b6e-f05375a1076e-13ced740-af5b-4bf5-a650-4e9429d0cc91" by "_create_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-d183ccbc-65b3-4d24-8b6e-f05375a1076e-13ced740-af5b-4bf5-a650-4e9429d0cc91" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Creating volume 13ced740-af5b-4bf5-a650-4e9429d0cc91 from snapshot d183ccbc-65b3-4d24-8b6e-f05375a1076e {{(pid=81312) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-13ced740-af5b-4bf5-a650-4e9429d0cc91" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-13ced740-af5b-4bf5-a650-4e9429d0cc91" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] snapshot: d183ccbc-65b3-4d24-8b6e-f05375a1076e, volume: 13ced740-af5b-4bf5-a650-4e9429d0cc91, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a24a4f5-9ca2-4d3f-89f7-432196d526f4]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:20 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e Apr 28 00:01:20 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:20 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8766bfaa-5993-49a5-9c72-fd60c17a2584(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9014ef6c-8787-4ab1-a3fd-a55256cf430b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:20 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 Apr 28 00:01:20 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:21 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584" returned: 0 in 0.503s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:21 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 00:01:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:21 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 Apr 28 00:01:21 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:25 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91" returned: 0 in 4.415s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:25 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1ce9db-910c-454d-a075-332789c4425f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:25 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 Apr 28 00:01:25 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:26 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584" returned: 0 in 0.620s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 00:01:26 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Converted 1024.00 MB image at 231.87 MB/s Apr 28 00:01:26 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 is being set with open permissions: ugo+rw Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:26 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 Apr 28 00:01:26 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:26 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91" returned: 0 in 0.427s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-13ced740-af5b-4bf5-a650-4e9429d0cc91" released by "_copy_volume_from_snapshot" :: held 6.572s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-d183ccbc-65b3-4d24-8b6e-f05375a1076e-13ced740-af5b-4bf5-a650-4e9429d0cc91" released by "_create_volume_from_snapshot" :: held 6.603s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.621s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d2be64-57ab-4dc2-9fed-5f22210e8ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ced740-af5b-4bf5-a650-4e9429d0cc91', 'volume_size': 2, 'snapshot_id': 'd183ccbc-65b3-4d24-8b6e-f05375a1076e'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5415ffc-f34b-42ba-aa57-f7ffcce182a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:26 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Volume volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 (13ced740-af5b-4bf5-a650-4e9429d0cc91): created successfully Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5415ffc-f34b-42ba-aa57-f7ffcce182a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (bca16d6a-d9b7-402e-b202-b06269790d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-78769dc9-fcb8-4013-9d90-1cf58cea906a tempest-VolumesSnapshotTestJSON-102696425 None] Created volume successfully. Apr 28 00:01:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-13ced740-af5b-4bf5-a650-4e9429d0cc91-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-13ced740-af5b-4bf5-a650-4e9429d0cc91-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-13ced740-af5b-4bf5-a650-4e9429d0cc91" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-13ced740-af5b-4bf5-a650-4e9429d0cc91" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:27 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[15643b5e-def3-45d8-a7fd-b788c0a13eda]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:27 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 Apr 28 00:01:27 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:28 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91" returned: 0 in 0.518s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:28 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91 Apr 28 00:01:28 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:28 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13ced740-af5b-4bf5-a650-4e9429d0cc91" returned: 0 in 0.456s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-13ced740-af5b-4bf5-a650-4e9429d0cc91" released by "delete_volume" :: held 1.017s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Created reservations ['29a651d1-5cb1-4744-8ddb-571ad7b661aa', '913525a9-91aa-4cc3-9d83-82c49c20cdb0', '95f65123-98ec-451c-8362-ea34a8e0b8d9', 'fadbe884-21aa-402a-b908-ae21ad487333'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:28 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:01:28 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:29 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.449s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:01:29 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Deleted volume successfully. Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cd10185d-54c1-4267-83f7-adf0da0ead10 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-13ced740-af5b-4bf5-a650-4e9429d0cc91-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-d183ccbc-65b3-4d24-8b6e-f05375a1076e-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-d183ccbc-65b3-4d24-8b6e-f05375a1076e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-8766bfaa-5993-49a5-9c72-fd60c17a2584" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-8766bfaa-5993-49a5-9c72-fd60c17a2584" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-d183ccbc-65b3-4d24-8b6e-f05375a1076e" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-d183ccbc-65b3-4d24-8b6e-f05375a1076e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Deleting offline snapshot d183ccbc-65b3-4d24-8b6e-f05375a1076e of volume 8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] snapshot_file for this snap is: volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d09ec6a-0a45-4bc6-a557-c5b1515d2893]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:29 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e Apr 28 00:01:29 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:30 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e" returned: 0 in 0.515s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8766bfaa-5993-49a5-9c72-fd60c17a2584(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:01:30 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc07fbd9-1aeb-466a-a143-02889da60618]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:30 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 Apr 28 00:01:30 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:30 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584" returned: 0 in 0.505s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:30 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e Apr 28 00:01:30 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:31 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e" returned: 0 in 0.544s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:31 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e Apr 28 00:01:31 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:31 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584.d183ccbc-65b3-4d24-8b6e-f05375a1076e" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:31 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-d183ccbc-65b3-4d24-8b6e-f05375a1076e" released by "_delete_snapshot" :: held 2.101s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:31 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-8766bfaa-5993-49a5-9c72-fd60c17a2584" released by "delete_snapshot" :: held 2.127s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:31 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Created reservations ['3d228294-c85d-46d4-83d5-cf69e582ca40', '5a23fce0-4ddc-4bc4-a009-92b126a2f509', '7f5d7585-66a5-408c-b684-d217accd7620', '03573c19-58f9-4c1d-885e-809f4a15c1ee'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:01:31 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Delete snapshot completed successfully. Apr 28 00:01:31 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-8dd1495d-6180-465f-8883-f94a9ee850b7 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-d183ccbc-65b3-4d24-8b6e-f05375a1076e-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-8766bfaa-5993-49a5-9c72-fd60c17a2584-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-8766bfaa-5993-49a5-9c72-fd60c17a2584-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-8766bfaa-5993-49a5-9c72-fd60c17a2584" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-8766bfaa-5993-49a5-9c72-fd60c17a2584" acquired by "delete_volume" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:33 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[442f15f7-5d8e-4340-aaa3-72c31bcbc618]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:33 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 Apr 28 00:01:33 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:33 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584" returned: 0 in 0.505s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:33 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584 Apr 28 00:01:33 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:34 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8766bfaa-5993-49a5-9c72-fd60c17a2584" returned: 0 in 0.446s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-8766bfaa-5993-49a5-9c72-fd60c17a2584" released by "delete_volume" :: held 1.011s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Created reservations ['92424d82-80f2-40ec-bbf6-dc57ee3f273b', 'f524f595-3ed9-4f4d-b2c7-c902430997ea', '9d0b3dad-db63-49a6-b1e3-82762357bff8', 'd1b8bc72-a521-406b-b9eb-1a6acce7f7df'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:34 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:01:34 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:34 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.430s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:01:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Deleted volume successfully. Apr 28 00:01:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-54fbe9e6-7368-4061-bd59-f8fe003d5f32 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-8766bfaa-5993-49a5-9c72-fd60c17a2584-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (592e822d-c0a7-4670-9cf1-d8e36a10d97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdba8f3-2fd0-48fe-ad84-e4641bc7e1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdba8f3-2fd0-48fe-ad84-e4641bc7e1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1318950922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccef1f5d-9e83-455e-abf7-820218aef594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26233c4bdc4744db95ddc5d7d775df32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:01:35Z,use_quota=True,user_id='d67e0865950e493abe218a129b969bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b0a7e1-5efe-4bb9-afde-0a541cb159f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b0a7e1-5efe-4bb9-afde-0a541cb159f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d60f48d-5b6e-4140-ad6b-8f87d7cfb44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d60f48d-5b6e-4140-ad6b-8f87d7cfb44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccef1f5d-9e83-455e-abf7-820218aef594', 'volume_name': 'volume-ccef1f5d-9e83-455e-abf7-820218aef594', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921f6a87-6688-449f-a15f-c94490df609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921f6a87-6688-449f-a15f-c94490df609c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7e1cf7-a981-442a-a744-ffc0fafebb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:35 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Volume ccef1f5d-9e83-455e-abf7-820218aef594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccef1f5d-9e83-455e-abf7-820218aef594', 'volume_size': 1} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1318950922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccef1f5d-9e83-455e-abf7-820218aef594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26233c4bdc4744db95ddc5d7d775df32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:01:35Z,use_quota=True,user_id='d67e0865950e493abe218a129b969bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Creating volume ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:01:35 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:01:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:35 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 1073741824 Apr 28 00:01:35 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:36 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 1073741824" returned: 0 in 0.619s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:36 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 Apr 28 00:01:36 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:36 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594" returned: 0 in 0.438s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:01:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7e1cf7-a981-442a-a744-ffc0fafebb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccef1f5d-9e83-455e-abf7-820218aef594', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da6100-5005-45f1-842c-669cacbf1c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:36 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Volume volume-ccef1f5d-9e83-455e-abf7-820218aef594 (ccef1f5d-9e83-455e-abf7-820218aef594): created successfully Apr 28 00:01:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da6100-5005-45f1-842c-669cacbf1c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (592e822d-c0a7-4670-9cf1-d8e36a10d97b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2c4a6d4f-f327-491d-a256-669cee8532e6 tempest-VolumesSnapshotTestJSON-102696425 None] Created volume successfully. Apr 28 00:01:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Creating offline snapshot 5cab979b-80d9-4b2f-8b98-634e49d7f1bb of volume ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:01:37 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3b7a91-a955-47c8-9e9c-820d637665e7]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:37 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 Apr 28 00:01:37 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:38 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:38 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb 1G Apr 28 00:01:38 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:38 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb 1G" returned: 0 in 0.592s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccef1f5d-9e83-455e-abf7-820218aef594 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:38 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccef1f5d-9e83-455e-abf7-820218aef594 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb Apr 28 00:01:38 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:39 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccef1f5d-9e83-455e-abf7-820218aef594 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb" returned: 0 in 0.466s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:39 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb is being set with open permissions: ugo+rw Apr 28 00:01:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:39 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb Apr 28 00:01:39 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:39 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb" returned: 0 in 0.431s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:39 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.info Apr 28 00:01:39 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:40 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.info" returned: 0 in 0.444s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:40 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.info is being set with open permissions: ugo+rw Apr 28 00:01:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:40 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.info Apr 28 00:01:40 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:40 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.info" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:40 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d4258877-596c-4ff2-817d-2b2f90064ecc tempest-VolumesSnapshotTestJSON-102696425 None] Create snapshot completed successfully Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (8407071d-6e73-4c6b-ba33-17b9fe46fdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebf0add-a55e-433d-93b9-469ee555aabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebf0add-a55e-433d-93b9-469ee555aabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1049498325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf77a2e-c095-4db4-a7ba-d81113582e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26233c4bdc4744db95ddc5d7d775df32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5cab979b-80d9-4b2f-8b98-634e49d7f1bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:01:41Z,use_quota=True,user_id='d67e0865950e493abe218a129b969bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65363ff-dd8c-471f-818a-b84bc74342c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65363ff-dd8c-471f-818a-b84bc74342c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2010e3bf-7882-4637-b280-cd9b3af5773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2010e3bf-7882-4637-b280-cd9b3af5773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0cf77a2e-c095-4db4-a7ba-d81113582e70', 'volume_name': 'volume-0cf77a2e-c095-4db4-a7ba-d81113582e70', 'volume_size': 1, 'snapshot_id': '5cab979b-80d9-4b2f-8b98-634e49d7f1bb'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d97bca2-e287-4a5f-a44f-d5344113d1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d97bca2-e287-4a5f-a44f-d5344113d1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903b309a-d893-4773-9305-d376631baebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:41 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Volume 0cf77a2e-c095-4db4-a7ba-d81113582e70: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0cf77a2e-c095-4db4-a7ba-d81113582e70', 'volume_size': 1, 'snapshot_id': '5cab979b-80d9-4b2f-8b98-634e49d7f1bb'} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-5cab979b-80d9-4b2f-8b98-634e49d7f1bb-0cf77a2e-c095-4db4-a7ba-d81113582e70" by "_create_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-5cab979b-80d9-4b2f-8b98-634e49d7f1bb-0cf77a2e-c095-4db4-a7ba-d81113582e70" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Creating volume 0cf77a2e-c095-4db4-a7ba-d81113582e70 from snapshot 5cab979b-80d9-4b2f-8b98-634e49d7f1bb {{(pid=81312) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-0cf77a2e-c095-4db4-a7ba-d81113582e70" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-0cf77a2e-c095-4db4-a7ba-d81113582e70" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] snapshot: 5cab979b-80d9-4b2f-8b98-634e49d7f1bb, volume: 0cf77a2e-c095-4db4-a7ba-d81113582e70, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[003c88a1-84a5-488d-a65c-f1df4b7b4526]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:41 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb Apr 28 00:01:41 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:41 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb" returned: 0 in 0.513s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccef1f5d-9e83-455e-abf7-820218aef594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f335635-44fa-483e-b15d-a5c94785c0b8]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:42 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 Apr 28 00:01:42 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:42 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594" returned: 0 in 0.531s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:42 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 00:01:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:42 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 Apr 28 00:01:42 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 00:01:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:45 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:01:45 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:46 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.456s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:46 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:01:46 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70" returned: 0 in 4.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:46 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6e5a73-6724-4fec-b3aa-93def59c3a0b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:47 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 Apr 28 00:01:47 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:47 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594" returned: 0 in 0.628s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:47 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 00:01:47 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Converted 1024.00 MB image at 229.55 MB/s Apr 28 00:01:47 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 is being set with open permissions: ugo+rw Apr 28 00:01:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:47 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 Apr 28 00:01:47 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:48 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70" returned: 0 in 0.435s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-0cf77a2e-c095-4db4-a7ba-d81113582e70" released by "_copy_volume_from_snapshot" :: held 6.660s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-5cab979b-80d9-4b2f-8b98-634e49d7f1bb-0cf77a2e-c095-4db4-a7ba-d81113582e70" released by "_create_volume_from_snapshot" :: held 6.688s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.702s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903b309a-d893-4773-9305-d376631baebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf77a2e-c095-4db4-a7ba-d81113582e70', 'volume_size': 1, 'snapshot_id': '5cab979b-80d9-4b2f-8b98-634e49d7f1bb'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ffd1fa-55b5-4d00-9674-86b6bda3429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:01:48 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Volume volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 (0cf77a2e-c095-4db4-a7ba-d81113582e70): created successfully Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ffd1fa-55b5-4d00-9674-86b6bda3429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Flow 'volume_create_manager' (8407071d-6e73-4c6b-ba33-17b9fe46fdbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:01:48 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-94125c36-e1ab-42dc-abca-ab52ea2f3703 tempest-VolumesSnapshotTestJSON-102696425 None] Created volume successfully. Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-0cf77a2e-c095-4db4-a7ba-d81113582e70-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-0cf77a2e-c095-4db4-a7ba-d81113582e70-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-0cf77a2e-c095-4db4-a7ba-d81113582e70" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-0cf77a2e-c095-4db4-a7ba-d81113582e70" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:49 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[665bd223-381b-43d4-86ec-407b95a1e146]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:49 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 Apr 28 00:01:49 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:49 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70" returned: 0 in 0.499s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:49 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70 Apr 28 00:01:49 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:49 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-0cf77a2e-c095-4db4-a7ba-d81113582e70" returned: 0 in 0.438s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-0cf77a2e-c095-4db4-a7ba-d81113582e70" released by "delete_volume" :: held 0.975s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Created reservations ['036cfea3-62c1-48a6-bfe0-a440aa4dd34f', '703231f2-c75a-413c-845c-8a4c907c8954', '82d690c6-3c57-487a-971d-cebdd2a1ef48', '03aa49e8-e83a-404c-a50a-8851d8284bab'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:50 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:01:50 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:50 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.425s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:01:50 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Deleted volume successfully. Apr 28 00:01:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1872a176-4401-4fe5-b847-2847e99e9cf9 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-0cf77a2e-c095-4db4-a7ba-d81113582e70-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-5cab979b-80d9-4b2f-8b98-634e49d7f1bb-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-5cab979b-80d9-4b2f-8b98-634e49d7f1bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-ccef1f5d-9e83-455e-abf7-820218aef594" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-ccef1f5d-9e83-455e-abf7-820218aef594" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-5cab979b-80d9-4b2f-8b98-634e49d7f1bb" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-5cab979b-80d9-4b2f-8b98-634e49d7f1bb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Deleting offline snapshot 5cab979b-80d9-4b2f-8b98-634e49d7f1bb of volume ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] snapshot_file for this snap is: volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ad0fa0-7fd1-4980-909e-9e9cfbc5dea4]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:51 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb Apr 28 00:01:51 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:51 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb" returned: 0 in 0.510s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccef1f5d-9e83-455e-abf7-820218aef594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17572691-cc63-4f43-9cdc-06e3bdc5ba8d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:51 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 Apr 28 00:01:51 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:52 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594" returned: 0 in 0.502s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:52 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb Apr 28 00:01:52 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:52 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:52 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb Apr 28 00:01:52 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:53 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594.5cab979b-80d9-4b2f-8b98-634e49d7f1bb" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-5cab979b-80d9-4b2f-8b98-634e49d7f1bb" released by "_delete_snapshot" :: held 2.072s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-ccef1f5d-9e83-455e-abf7-820218aef594" released by "delete_snapshot" :: held 2.101s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:53 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Created reservations ['621af9f3-be34-4062-8a37-ed48dae3b3e1', '7fd85b27-a4dc-49de-9156-af7055e9c0c3', 'b36f7fdc-316a-4c2c-91de-4a29d4471ceb', '7e58c5c6-f93c-4311-8a35-3277eb6f2550'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:01:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Delete snapshot completed successfully. Apr 28 00:01:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5065682d-c32a-4941-b567-09adce76d14e tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-5cab979b-80d9-4b2f-8b98-634e49d7f1bb-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-ccef1f5d-9e83-455e-abf7-820218aef594-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-ccef1f5d-9e83-455e-abf7-820218aef594-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-ccef1f5d-9e83-455e-abf7-820218aef594" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-ccef1f5d-9e83-455e-abf7-820218aef594" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:54 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fdbcd3-5ca2-4d26-aa17-0aeb9439b0af]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:54 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 Apr 28 00:01:54 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:55 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594" returned: 0 in 0.500s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:55 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594 Apr 28 00:01:55 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:55 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ccef1f5d-9e83-455e-abf7-820218aef594" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-ccef1f5d-9e83-455e-abf7-820218aef594" released by "delete_volume" :: held 0.999s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Created reservations ['03f0ab04-a902-4088-9ae2-6f07a3bbc991', 'd3843a8f-2b47-4ece-8f4d-a6c1cb36ca05', '1aea3644-3443-4cc8-9fd1-13cb9b0b446d', '5810c43a-fddc-40bc-a59d-96e6ffdd31cb'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:55 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:01:55 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:56 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.429s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:56 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:01:56 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Deleted volume successfully. Apr 28 00:01:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2151c22-e2eb-4275-8414-3a0079cb1c74 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-ccef1f5d-9e83-455e-abf7-820218aef594-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-67ed9cec-536b-4cc7-836d-c0fe5d18b94c-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-67ed9cec-536b-4cc7-836d-c0fe5d18b94c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "cinder-quobyte-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:01:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:01:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d4caf-3f49-46a8-8565-e1b0c59a6e06]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:01:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:56 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c Apr 28 00:01:56 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:57 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" returned: 0 in 0.515s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:57 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c Apr 28 00:01:57 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:57 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" returned: 0 in 0.455s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-quobyte-67ed9cec-536b-4cc7-836d-c0fe5d18b94c" released by "delete_volume" :: held 1.029s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Created reservations ['dc46255c-44ea-4069-a1d9-4c201152106a', 'd0d283f9-2b71-4349-a80b-72c3a079bdad', 'd4b7cf48-7cee-4513-ab30-bcf5ad171ec0', '2e251699-2490-4c03-bfd3-50093da1e453'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:01:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:01:57 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:01:57 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:01:58 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 28 00:01:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.430s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:01:58 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:01:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Deleted volume successfully. Apr 28 00:01:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5eda8d86-308f-4534-8d2a-c4b8c53b2e86 tempest-VolumesSnapshotTestJSON-102696425 None] Lock "cinder-67ed9cec-536b-4cc7-836d-c0fe5d18b94c-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:03 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=73,cinder:UPDATE=70,cinder:DELETE=7,cinder:INSERT=25 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:02:03 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=67,cinder:INSERT=13,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:02:03 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:02:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Flow 'volume_create_manager' (22dc7c4a-3149-444f-b838-adc98c32f08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d348fbcb-5a75-441c-af46-538e0ea46685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d348fbcb-5a75-441c-af46-538e0ea46685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-120149059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4201c3-850f-436a-8446-6131cd6c9184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5283ad17c97d43bcb58f017458075979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:02:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:02:04Z,use_quota=True,user_id='370c2be5f76140d88a90cf524c770fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb977913-953b-4191-a3de-0782885db52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb977913-953b-4191-a3de-0782885db52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7582e122-7ea5-48e5-a792-ca338022241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7582e122-7ea5-48e5-a792-ca338022241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4201c3-850f-436a-8446-6131cd6c9184', 'volume_name': 'volume-7c4201c3-850f-436a-8446-6131cd6c9184', 'volume_size': 2}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650d34f3-8145-42e3-a812-87be9a610593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650d34f3-8145-42e3-a812-87be9a610593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e70a8e7-8238-4abf-b302-b4b005e98edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:04 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Volume 7c4201c3-850f-436a-8446-6131cd6c9184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4201c3-850f-436a-8446-6131cd6c9184', 'volume_size': 2} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-120149059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4201c3-850f-436a-8446-6131cd6c9184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5283ad17c97d43bcb58f017458075979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:02:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:02:04Z,use_quota=True,user_id='370c2be5f76140d88a90cf524c770fa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Creating volume 7c4201c3-850f-436a-8446-6131cd6c9184 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:02:04 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 2147483648 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:04 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 2147483648 Apr 28 00:02:04 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:04 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 2147483648" returned: 0 in 0.624s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:04 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 Apr 28 00:02:04 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:05 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184" returned: 0 in 0.448s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:02:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e70a8e7-8238-4abf-b302-b4b005e98edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4201c3-850f-436a-8446-6131cd6c9184', 'volume_size': 2}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71698f97-f98a-4c93-a2ca-140214af1366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:05 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Volume volume-7c4201c3-850f-436a-8446-6131cd6c9184 (7c4201c3-850f-436a-8446-6131cd6c9184): created successfully Apr 28 00:02:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71698f97-f98a-4c93-a2ca-140214af1366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Flow 'volume_create_manager' (22dc7c4a-3149-444f-b838-adc98c32f08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:05 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d1113e19-2bb2-4584-a55e-c5463e7ebdb3 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Created volume successfully. Apr 28 00:02:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Creating offline snapshot 7d40f744-0ea9-4e84-b72e-eaed8499423e of volume 7c4201c3-850f-436a-8446-6131cd6c9184 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:02:06 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[546049e4-a1b2-4f4f-8ea0-a769b85691d6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:06 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 Apr 28 00:02:06 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:06 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184" returned: 0 in 0.495s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e 2G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:06 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e 2G Apr 28 00:02:06 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:07 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e 2G" returned: 0 in 0.571s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4201c3-850f-436a-8446-6131cd6c9184 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:07 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4201c3-850f-436a-8446-6131cd6c9184 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e Apr 28 00:02:07 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:07 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4201c3-850f-436a-8446-6131cd6c9184 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e" returned: 0 in 0.477s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:07 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e is being set with open permissions: ugo+rw Apr 28 00:02:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:07 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e Apr 28 00:02:07 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:08 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e" returned: 0 in 0.424s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:08 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.info Apr 28 00:02:08 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:08 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.info" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:08 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.info is being set with open permissions: ugo+rw Apr 28 00:02:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:08 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.info Apr 28 00:02:08 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:09 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.info" returned: 0 in 0.431s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.919s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:09 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5af85b5d-2405-4d87-82c7-5eed4cb8f785 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Create snapshot completed successfully Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Acquiring lock "cinder-7d40f744-0ea9-4e84-b72e-eaed8499423e-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-7d40f744-0ea9-4e84-b72e-eaed8499423e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Acquiring lock "cinder-quobyte-7c4201c3-850f-436a-8446-6131cd6c9184" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-quobyte-7c4201c3-850f-436a-8446-6131cd6c9184" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Acquiring lock "cinder-quobyte-7d40f744-0ea9-4e84-b72e-eaed8499423e" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-quobyte-7d40f744-0ea9-4e84-b72e-eaed8499423e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Deleting offline snapshot 7d40f744-0ea9-4e84-b72e-eaed8499423e of volume 7c4201c3-850f-436a-8446-6131cd6c9184 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] snapshot_file for this snap is: volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[168564fd-cf12-459e-ae94-59b7fb073b93]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:09 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e Apr 28 00:02:09 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:09 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e" returned: 0 in 0.504s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c4201c3-850f-436a-8446-6131cd6c9184(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:02:10 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1465ab18-cbcc-4135-adc5-4bf0c422d7c3]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:10 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 Apr 28 00:02:10 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:10 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184" returned: 0 in 0.500s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:10 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e Apr 28 00:02:10 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:11 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e" returned: 0 in 0.532s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:11 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e Apr 28 00:02:11 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:11 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184.7d40f744-0ea9-4e84-b72e-eaed8499423e" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-quobyte-7d40f744-0ea9-4e84-b72e-eaed8499423e" released by "_delete_snapshot" :: held 2.074s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-quobyte-7c4201c3-850f-436a-8446-6131cd6c9184" released by "delete_snapshot" :: held 2.099s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:11 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Created reservations ['59c2854f-c02e-4758-9a92-093b919871ba', 'a8a09d1a-1010-4e94-ae4a-4d58484bcfc3', 'c8a6db8e-cca2-4325-b265-bcd60bdeefa9', '38062bd5-b08e-4e47-8b66-ed5f19a6c13d'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:02:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Delete snapshot completed successfully. Apr 28 00:02:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-3b0be978-1932-4e83-9daf-028aeb3454b2 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-7d40f744-0ea9-4e84-b72e-eaed8499423e-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Acquiring lock "cinder-7c4201c3-850f-436a-8446-6131cd6c9184-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-7c4201c3-850f-436a-8446-6131cd6c9184-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Acquiring lock "cinder-quobyte-7c4201c3-850f-436a-8446-6131cd6c9184" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-quobyte-7c4201c3-850f-436a-8446-6131cd6c9184" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:12 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[095fb2b9-41b5-416b-9c63-c30d8c2692e9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:12 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 Apr 28 00:02:12 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:13 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184" returned: 0 in 0.534s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:13 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184 Apr 28 00:02:13 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:13 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7c4201c3-850f-436a-8446-6131cd6c9184" returned: 0 in 0.450s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-quobyte-7c4201c3-850f-436a-8446-6131cd6c9184" released by "delete_volume" :: held 1.043s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Created reservations ['6fc521cc-175d-47fe-810f-d337296204d7', 'e1896532-c7d3-4886-bfac-7a1ccd7894da', '0caf1df7-1057-4659-a5ec-fccf2afe8321', '1ff35e6d-7109-459b-9eb8-a2df99e30252'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:13 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:02:13 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:14 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.475s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:14 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:02:14 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Deleted volume successfully. Apr 28 00:02:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca62a993-c3f8-49e1-836b-39c352efd388 tempest-VolumesSnapshotNegativeTestJSON-466999093 None] Lock "cinder-7c4201c3-850f-436a-8446-6131cd6c9184-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Flow 'volume_create_manager' (1eecca38-7ffe-4032-ab72-9179860d45a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada40f5a-4636-4fc6-a33d-f5304903feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada40f5a-4636-4fc6-a33d-f5304903feee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-803760081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479091ae-33e0-4471-b974-2697334a0c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe02f64b964901a6feec38fac91962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:02:17Z,use_quota=True,user_id='56ca9f6844654b22ac79ac70ef91d364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27741922-caf8-4650-8c21-7a7c8b3b99c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27741922-caf8-4650-8c21-7a7c8b3b99c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84523c65-806e-4a8d-9df2-a8c34d995e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84523c65-806e-4a8d-9df2-a8c34d995e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479091ae-33e0-4471-b974-2697334a0c6c', 'volume_name': 'volume-479091ae-33e0-4471-b974-2697334a0c6c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735c519d-40c6-4840-91c2-24f8f393476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735c519d-40c6-4840-91c2-24f8f393476e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3eceb54-0aa3-4eaf-9867-f437f31bb520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:17 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Volume 479091ae-33e0-4471-b974-2697334a0c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479091ae-33e0-4471-b974-2697334a0c6c', 'volume_size': 1} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-803760081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479091ae-33e0-4471-b974-2697334a0c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe02f64b964901a6feec38fac91962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:02:17Z,use_quota=True,user_id='56ca9f6844654b22ac79ac70ef91d364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Creating volume 479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:02:17 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:17 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c 1073741824 Apr 28 00:02:17 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:17 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c 1073741824" returned: 0 in 0.600s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:18 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c Apr 28 00:02:18 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:18 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c" returned: 0 in 0.443s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:18 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:02:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3eceb54-0aa3-4eaf-9867-f437f31bb520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479091ae-33e0-4471-b974-2697334a0c6c', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47b8646-e123-44ec-8bab-f2d35aa6d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:18 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Volume volume-479091ae-33e0-4471-b974-2697334a0c6c (479091ae-33e0-4471-b974-2697334a0c6c): created successfully Apr 28 00:02:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47b8646-e123-44ec-8bab-f2d35aa6d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:18 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Flow 'volume_create_manager' (1eecca38-7ffe-4032-ab72-9179860d45a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:18 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e20d54d2-68a6-40c6-87d0-1d143f06d8c4 tempest-VolumeDependencyTests-1124038098 None] Created volume successfully. Apr 28 00:02:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Creating offline snapshot fcb4a9db-0681-4778-a2c5-46703fec7168 of volume 479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:02:19 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[4511bff6-c496-49f7-852b-fbb51237c56e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:19 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c Apr 28 00:02:19 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:20 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c" returned: 0 in 0.508s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:20 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 1G Apr 28 00:02:20 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:20 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 1G" returned: 0 in 0.580s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-479091ae-33e0-4471-b974-2697334a0c6c -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:20 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-479091ae-33e0-4471-b974-2697334a0c6c -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 Apr 28 00:02:20 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:21 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-479091ae-33e0-4471-b974-2697334a0c6c -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168" returned: 0 in 0.462s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:21 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 is being set with open permissions: ugo+rw Apr 28 00:02:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:21 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 Apr 28 00:02:21 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:21 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168" returned: 0 in 0.437s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:21 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.info Apr 28 00:02:21 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:22 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.info" returned: 0 in 0.426s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:22 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.info is being set with open permissions: ugo+rw Apr 28 00:02:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:22 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.info Apr 28 00:02:22 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:22 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.info" returned: 0 in 0.414s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.920s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:22 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6ac6beca-07a1-4c50-b178-18f11cecdd6e tempest-VolumeDependencyTests-1124038098 None] Create snapshot completed successfully Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Flow 'volume_create_manager' (d0b3d82e-98bf-4e2d-b320-aa9424b072da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f03e71a-f4d6-428f-b93c-07d8373196ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f03e71a-f4d6-428f-b93c-07d8373196ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2124108677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b51743-b9ea-4d6c-ae3c-06a2ce684288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe02f64b964901a6feec38fac91962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fcb4a9db-0681-4778-a2c5-46703fec7168,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:02:23Z,use_quota=True,user_id='56ca9f6844654b22ac79ac70ef91d364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67552fd8-2dd7-4309-9326-714ebead302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67552fd8-2dd7-4309-9326-714ebead302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f788b8-89dc-4b71-8192-13b288324e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f788b8-89dc-4b71-8192-13b288324e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3b51743-b9ea-4d6c-ae3c-06a2ce684288', 'volume_name': 'volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288', 'volume_size': 1, 'snapshot_id': 'fcb4a9db-0681-4778-a2c5-46703fec7168'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33cdd88c-5056-4989-a12a-75bb49ba0eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33cdd88c-5056-4989-a12a-75bb49ba0eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd878468-d048-464d-8ffa-f572ecd316c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:23 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Volume c3b51743-b9ea-4d6c-ae3c-06a2ce684288: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288', 'volume_size': 1, 'snapshot_id': 'fcb4a9db-0681-4778-a2c5-46703fec7168'} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-fcb4a9db-0681-4778-a2c5-46703fec7168-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" by "_create_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-fcb4a9db-0681-4778-a2c5-46703fec7168-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Creating volume c3b51743-b9ea-4d6c-ae3c-06a2ce684288 from snapshot fcb4a9db-0681-4778-a2c5-46703fec7168 {{(pid=81312) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] snapshot: fcb4a9db-0681-4778-a2c5-46703fec7168, volume: c3b51743-b9ea-4d6c-ae3c-06a2ce684288, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d825413b-80bd-44a6-aaf5-cd55e28fe54f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:23 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 Apr 28 00:02:23 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:23 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168" returned: 0 in 0.510s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-479091ae-33e0-4471-b974-2697334a0c6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12fa382-b6a5-48bd-9440-ccc928e399d3]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:23 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c Apr 28 00:02:23 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:24 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:24 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 00:02:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:24 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 Apr 28 00:02:24 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:28 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" returned: 0 in 4.443s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:28 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a861c91-fe46-4220-97cf-af81f820dacd]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:28 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c Apr 28 00:02:28 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:29 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c" returned: 0 in 0.665s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 00:02:29 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Converted 1024.00 MB image at 230.38 MB/s Apr 28 00:02:29 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 is being set with open permissions: ugo+rw Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:29 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 Apr 28 00:02:29 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:29 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" returned: 0 in 0.455s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" released by "_copy_volume_from_snapshot" :: held 6.687s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-fcb4a9db-0681-4778-a2c5-46703fec7168-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" released by "_create_volume_from_snapshot" :: held 6.716s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.737s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd878468-d048-464d-8ffa-f572ecd316c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288', 'volume_size': 1, 'snapshot_id': 'fcb4a9db-0681-4778-a2c5-46703fec7168'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c9a626-b827-4eb2-b523-e84c50d13103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:29 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Volume volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 (c3b51743-b9ea-4d6c-ae3c-06a2ce684288): created successfully Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c9a626-b827-4eb2-b523-e84c50d13103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Flow 'volume_create_manager' (d0b3d82e-98bf-4e2d-b320-aa9424b072da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:29 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-13921e6a-b79a-40fc-bfb2-8e6ebaa3bf42 tempest-VolumeDependencyTests-1124038098 None] Created volume successfully. Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-fcb4a9db-0681-4778-a2c5-46703fec7168-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-fcb4a9db-0681-4778-a2c5-46703fec7168-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-479091ae-33e0-4471-b974-2697334a0c6c" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-479091ae-33e0-4471-b974-2697334a0c6c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-fcb4a9db-0681-4778-a2c5-46703fec7168" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-fcb4a9db-0681-4778-a2c5-46703fec7168" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Deleting offline snapshot fcb4a9db-0681-4778-a2c5-46703fec7168 of volume 479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] snapshot_file for this snap is: volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[9785da36-541a-4a5c-9a1e-0daf5bb88476]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:30 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 Apr 28 00:02:30 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:31 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168" returned: 0 in 0.502s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-479091ae-33e0-4471-b974-2697334a0c6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:02:31 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[52670148-2480-46ab-b876-0329f6db762e]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:31 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c Apr 28 00:02:31 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:31 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c" returned: 0 in 0.520s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:31 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 Apr 28 00:02:31 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:32 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168" returned: 0 in 0.522s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:32 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168 Apr 28 00:02:32 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:32 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c.fcb4a9db-0681-4778-a2c5-46703fec7168" returned: 0 in 0.426s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-fcb4a9db-0681-4778-a2c5-46703fec7168" released by "_delete_snapshot" :: held 2.069s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-479091ae-33e0-4471-b974-2697334a0c6c" released by "delete_snapshot" :: held 2.095s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:32 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Created reservations ['1f8e38f5-ae23-4f92-9303-8875a4bae078', '0f241cae-79bf-4eb0-8c12-91ebb540cbfc', 'ecd6ef51-8138-4df1-9de6-0145704e0a52', '164b2c89-d78f-446b-8093-860dfcddc9a1'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:02:32 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Delete snapshot completed successfully. Apr 28 00:02:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-907908d4-69b9-4678-8d15-63bc62c1cf29 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-fcb4a9db-0681-4778-a2c5-46703fec7168-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-479091ae-33e0-4471-b974-2697334a0c6c-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-479091ae-33e0-4471-b974-2697334a0c6c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-479091ae-33e0-4471-b974-2697334a0c6c" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:33 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-479091ae-33e0-4471-b974-2697334a0c6c" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:33 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[baebb48f-bfc1-4b01-ac3a-258c088fe7bb]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:34 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c Apr 28 00:02:34 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:34 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c" returned: 0 in 0.488s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:34 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c Apr 28 00:02:34 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:34 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-479091ae-33e0-4471-b974-2697334a0c6c" returned: 0 in 0.444s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-479091ae-33e0-4471-b974-2697334a0c6c" released by "delete_volume" :: held 0.991s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:34 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Created reservations ['1e989930-bc01-46ed-9ad8-92098aed1670', '15dd38a6-0e44-4a12-b42f-b9259df47377', '5e84a24d-76a7-4708-8431-19033701cc8a', '972b5883-cd7b-4f66-ac95-646eef905c0b'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:02:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:35 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:35 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:02:35 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:35 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.457s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:35 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:02:35 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Deleted volume successfully. Apr 28 00:02:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-11f0ad11-c158-4f27-9bc9-d4b943ccd8e7 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-479091ae-33e0-4471-b974-2697334a0c6c-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Flow 'volume_create_manager' (6a72f2ac-9c85-47df-9bac-99fe0bebf2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1fbd5b-b85b-427a-bc62-78d9f94acdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1fbd5b-b85b-427a-bc62-78d9f94acdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-593098021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d59a569-5d53-4939-80e3-b3cd68d40d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe02f64b964901a6feec38fac91962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:02:36Z,use_quota=True,user_id='56ca9f6844654b22ac79ac70ef91d364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1789953-b260-4f01-a693-8fdf83ad6491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1789953-b260-4f01-a693-8fdf83ad6491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90864f88-3e53-467d-8ee6-259bb9f3894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90864f88-3e53-467d-8ee6-259bb9f3894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d59a569-5d53-4939-80e3-b3cd68d40d07', 'volume_name': 'volume-9d59a569-5d53-4939-80e3-b3cd68d40d07', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a3c5d9-7261-4dd8-8db5-4b936986851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a3c5d9-7261-4dd8-8db5-4b936986851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fa5066-0f5a-4129-988f-6547822b264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:36 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Volume 9d59a569-5d53-4939-80e3-b3cd68d40d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d59a569-5d53-4939-80e3-b3cd68d40d07', 'volume_size': 1} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-593098021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d59a569-5d53-4939-80e3-b3cd68d40d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe02f64b964901a6feec38fac91962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:02:36Z,use_quota=True,user_id='56ca9f6844654b22ac79ac70ef91d364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Creating volume 9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:02:36 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:02:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:36 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 1073741824 Apr 28 00:02:36 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:37 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 1073741824" returned: 0 in 0.610s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:37 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 Apr 28 00:02:37 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:37 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07" returned: 0 in 0.431s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:02:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fa5066-0f5a-4129-988f-6547822b264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d59a569-5d53-4939-80e3-b3cd68d40d07', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473378b8-f079-4df3-9cc3-66a923d8acd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:37 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Volume volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 (9d59a569-5d53-4939-80e3-b3cd68d40d07): created successfully Apr 28 00:02:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473378b8-f079-4df3-9cc3-66a923d8acd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:37 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Flow 'volume_create_manager' (6a72f2ac-9c85-47df-9bac-99fe0bebf2ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:37 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-12127ac1-d508-46e0-94ac-eee07750c4aa tempest-VolumeDependencyTests-1124038098 None] Created volume successfully. Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Flow 'volume_create_manager' (db6b4411-2f20-45a5-98d8-2878db09c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2da698b-fcee-46ff-9992-f468b62112df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2da698b-fcee-46ff-9992-f468b62112df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1250217588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13087056-e656-4eae-b5bf-9afc00903c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe02f64b964901a6feec38fac91962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9d59a569-5d53-4939-80e3-b3cd68d40d07,status='creating',terminated_at=None,updated_at=2026-04-27T22:02:39Z,use_quota=True,user_id='56ca9f6844654b22ac79ac70ef91d364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23064d76-560c-4586-a982-4c94975f8064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23064d76-560c-4586-a982-4c94975f8064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fe4b55-952b-4962-b05d-4405b0137b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fe4b55-952b-4962-b05d-4405b0137b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '13087056-e656-4eae-b5bf-9afc00903c93', 'volume_name': 'volume-13087056-e656-4eae-b5bf-9afc00903c93', 'volume_size': 1, 'source_volid': '9d59a569-5d53-4939-80e3-b3cd68d40d07', 'source_volstatus': 'available'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab269c71-c3c8-4135-90ca-797219374e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab269c71-c3c8-4135-90ca-797219374e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5578561f-ad53-4edd-8c28-cea05b303c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:38 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Volume 13087056-e656-4eae-b5bf-9afc00903c93: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-13087056-e656-4eae-b5bf-9afc00903c93', 'volume_size': 1, 'source_volid': '9d59a569-5d53-4939-80e3-b3cd68d40d07', 'source_volstatus': 'available'} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:38 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Cloning volume 9d59a569-5d53-4939-80e3-b3cd68d40d07 to volume 13087056-e656-4eae-b5bf-9afc00903c93 Apr 28 00:02:38 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Creating offline snapshot 077637c4-bf75-4900-9ff5-e3284e25131b of volume 9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:02:39 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6110a-3e7b-4a69-b35f-eeb1304d5dc7]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:39 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 Apr 28 00:02:39 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:39 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:39 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b 1G Apr 28 00:02:39 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:40 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b 1G" returned: 0 in 0.577s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:40 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b Apr 28 00:02:40 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:40 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b" returned: 0 in 0.481s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:40 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b is being set with open permissions: ugo+rw Apr 28 00:02:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:40 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b Apr 28 00:02:40 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:41 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:41 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.info Apr 28 00:02:41 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:41 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.info" returned: 0 in 0.437s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:41 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.info is being set with open permissions: ugo+rw Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:41 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.info Apr 28 00:02:41 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:41 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.info" returned: 0 in 0.412s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-13087056-e656-4eae-b5bf-9afc00903c93" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-13087056-e656-4eae-b5bf-9afc00903c93" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] snapshot: 077637c4-bf75-4900-9ff5-e3284e25131b, volume: 13087056-e656-4eae-b5bf-9afc00903c93, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c475e35-b30b-4471-ada5-ad7c5b6e1ab6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:42 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b Apr 28 00:02:42 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:42 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b" returned: 0 in 0.495s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d59a569-5d53-4939-80e3-b3cd68d40d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:02:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 00:02:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 00:02:42 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[23917053-f9c7-40a0-994c-411f3f0eb3b1]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:42 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 Apr 28 00:02:42 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:42 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07" returned: 0 in 0.494s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:42 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 00:02:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:42 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 Apr 28 00:02:43 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 00:02:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:45 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:02:45 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:45 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.896s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:02:47 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93" returned: 0 in 4.518s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:47 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0873cd-796e-42b3-8d49-a36078b8d568]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:47 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 Apr 28 00:02:47 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:48 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07" returned: 0 in 0.624s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 00:02:48 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Converted 1024.00 MB image at 226.53 MB/s Apr 28 00:02:48 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 is being set with open permissions: ugo+rw Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:48 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 Apr 28 00:02:48 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:48 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93" returned: 0 in 0.423s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-13087056-e656-4eae-b5bf-9afc00903c93" released by "_copy_volume_from_snapshot" :: held 6.634s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-077637c4-bf75-4900-9ff5-e3284e25131b" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-077637c4-bf75-4900-9ff5-e3284e25131b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Deleting offline snapshot 077637c4-bf75-4900-9ff5-e3284e25131b of volume 9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] snapshot_file for this snap is: volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db4a95b-9ad8-47e9-a5ef-2ec16846b29d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:48 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b Apr 28 00:02:48 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:49 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b" returned: 0 in 0.498s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d59a569-5d53-4939-80e3-b3cd68d40d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:02:49 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2878b0-9d8d-410e-95e3-6bbbaf12f9c6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:49 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 Apr 28 00:02:49 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:49 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07" returned: 0 in 0.520s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:49 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b Apr 28 00:02:49 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:50 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b" returned: 0 in 0.513s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:50 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b Apr 28 00:02:50 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:50 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07.077637c4-bf75-4900-9ff5-e3284e25131b" returned: 0 in 0.418s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-077637c4-bf75-4900-9ff5-e3284e25131b" released by "_delete_snapshot" :: held 2.037s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.702s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:50 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5578561f-ad53-4edd-8c28-cea05b303c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13087056-e656-4eae-b5bf-9afc00903c93', 'volume_size': 1, 'source_volid': '9d59a569-5d53-4939-80e3-b3cd68d40d07', 'source_volstatus': 'available'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:50 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfc1c00-7db6-4bf0-8be5-4b30afcc6c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:02:50 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Volume volume-13087056-e656-4eae-b5bf-9afc00903c93 (13087056-e656-4eae-b5bf-9afc00903c93): created successfully Apr 28 00:02:50 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfc1c00-7db6-4bf0-8be5-4b30afcc6c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:02:50 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Flow 'volume_create_manager' (db6b4411-2f20-45a5-98d8-2878db09c57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:02:50 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-90cc8f17-17dc-4900-9cb1-454ea9c0ac55 tempest-VolumeDependencyTests-1124038098 None] Created volume successfully. Apr 28 00:02:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-9d59a569-5d53-4939-80e3-b3cd68d40d07-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-9d59a569-5d53-4939-80e3-b3cd68d40d07-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-9d59a569-5d53-4939-80e3-b3cd68d40d07" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-9d59a569-5d53-4939-80e3-b3cd68d40d07" acquired by "delete_volume" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ce4581-fdbb-4615-8557-818bb547ff3a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:51 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 Apr 28 00:02:51 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:52 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07" returned: 0 in 0.515s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:52 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07 Apr 28 00:02:52 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:52 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-9d59a569-5d53-4939-80e3-b3cd68d40d07" returned: 0 in 0.413s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-9d59a569-5d53-4939-80e3-b3cd68d40d07" released by "delete_volume" :: held 0.986s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Created reservations ['2c723ae9-d852-4024-9be3-9bc8dd0b84d5', '92b6a832-9aa9-4255-bcdf-9187e318eab9', '5d4ab20e-02db-4a65-a571-31c7be007a82', '54bf9829-e2cc-4f5e-b09b-a132a5d076a0'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:52 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:02:52 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:53 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:53 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:02:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Deleted volume successfully. Apr 28 00:02:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c3d5a5fc-4b5d-41ae-894e-314092859c54 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-9d59a569-5d53-4939-80e3-b3cd68d40d07-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-13087056-e656-4eae-b5bf-9afc00903c93-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-13087056-e656-4eae-b5bf-9afc00903c93-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-13087056-e656-4eae-b5bf-9afc00903c93" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-13087056-e656-4eae-b5bf-9afc00903c93" acquired by "delete_volume" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:54 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d53dae-5c80-49fc-b35e-190688340005]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:54 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 Apr 28 00:02:54 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:54 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93" returned: 0 in 0.507s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:54 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93 Apr 28 00:02:54 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:54 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-13087056-e656-4eae-b5bf-9afc00903c93" returned: 0 in 0.430s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:54 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-13087056-e656-4eae-b5bf-9afc00903c93" released by "delete_volume" :: held 0.973s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Created reservations ['c159100d-f252-4a62-8a03-7a89b82ce640', '5f9aaf43-0cbe-4c3d-ae05-06d8959d68fb', '47297379-3eb4-4c0c-b60e-9cdadd920abe', '79ed1773-e6b2-4f19-8e30-a4619a8fe399'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:55 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:02:55 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:55 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.420s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:02:55 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Deleted volume successfully. Apr 28 00:02:55 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-26dec0d4-283c-491b-9ab2-d35f539e9649 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-13087056-e656-4eae-b5bf-9afc00903c93-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-c3b51743-b9ea-4d6c-ae3c-06a2ce684288-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-c3b51743-b9ea-4d6c-ae3c-06a2ce684288-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "cinder-quobyte-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:02:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:02:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4011503-a027-4f1d-bb72-40504473697a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:02:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:56 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 Apr 28 00:02:56 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:56 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" returned: 0 in 0.499s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:56 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288 Apr 28 00:02:56 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:57 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" returned: 0 in 0.448s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-quobyte-c3b51743-b9ea-4d6c-ae3c-06a2ce684288" released by "delete_volume" :: held 0.988s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Created reservations ['e1ecfcfc-42ff-46fc-a83b-9d361bf52deb', '5acce328-9cdb-4231-8966-ec80e19f584d', '893c4744-09da-4f1c-96d3-a5cbf80ee6fd', '06f8c0e5-1775-46c2-9cf9-1e009dac5d7b'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:02:57 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:02:57 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:02:57 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.422s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:02:57 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Deleted volume successfully. Apr 28 00:02:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ff6e44b3-18d8-4402-9ff1-0a270de5fb00 tempest-VolumeDependencyTests-1124038098 None] Lock "cinder-c3b51743-b9ea-4d6c-ae3c-06a2ce684288-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Flow 'volume_create_manager' (3fdb39bf-c60d-4eff-9fcf-c8109ad69fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7d3306-306b-472a-9c57-e1568d05f56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7d3306-306b-472a-9c57-e1568d05f56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3766491c-51e8-42f2-ae29-50706ceae08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39350b46d13542e7bb123402fe17b946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:01Z,use_quota=True,user_id='5678eb19ebaf4a0ab58583a6488b98c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6efff2c-bd1a-4a0a-acb8-13d1bba84b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6efff2c-bd1a-4a0a-acb8-13d1bba84b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3be1230-17ee-4d8e-9833-5e521c8851dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3be1230-17ee-4d8e-9833-5e521c8851dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3766491c-51e8-42f2-ae29-50706ceae08a', 'volume_name': 'volume-3766491c-51e8-42f2-ae29-50706ceae08a', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1bb222-ed5e-4eb6-b0bb-b65caab62493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1bb222-ed5e-4eb6-b0bb-b65caab62493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcabb88c-afa7-46fc-98ce-0351ba8f412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:00 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Volume 3766491c-51e8-42f2-ae29-50706ceae08a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3766491c-51e8-42f2-ae29-50706ceae08a', 'volume_size': 1} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3766491c-51e8-42f2-ae29-50706ceae08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39350b46d13542e7bb123402fe17b946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:01Z,use_quota=True,user_id='5678eb19ebaf4a0ab58583a6488b98c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Creating volume 3766491c-51e8-42f2-ae29-50706ceae08a {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:00 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:00 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a 1073741824 Apr 28 00:03:00 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:01 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a 1073741824" returned: 0 in 0.593s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:01 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a Apr 28 00:03:01 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:01 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:01 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcabb88c-afa7-46fc-98ce-0351ba8f412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3766491c-51e8-42f2-ae29-50706ceae08a', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad78262-c4ff-42a6-b989-480688c49217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:01 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Volume volume-3766491c-51e8-42f2-ae29-50706ceae08a (3766491c-51e8-42f2-ae29-50706ceae08a): created successfully Apr 28 00:03:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad78262-c4ff-42a6-b989-480688c49217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Flow 'volume_create_manager' (3fdb39bf-c60d-4eff-9fcf-c8109ad69fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:02 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5848dc24-6ba5-4626-abd6-7188fd335cdf tempest-CinderUnicodeTest-821519063 None] Created volume successfully. Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Flow 'volume_create_manager' (5a8db172-8084-45b5-a79e-9a924ccc61a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d67cda-1138-4ae3-9d6e-cb9aaaaaf350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d67cda-1138-4ae3-9d6e-cb9aaaaaf350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-974121909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653e2bdb-1617-441f-9804-6055d7ee8907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39350b46d13542e7bb123402fe17b946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:03Z,use_quota=True,user_id='5678eb19ebaf4a0ab58583a6488b98c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344a88cd-88f3-4646-a859-84e677c4451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344a88cd-88f3-4646-a859-84e677c4451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf666a1-fbad-431b-9887-456244b3ea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf666a1-fbad-431b-9887-456244b3ea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653e2bdb-1617-441f-9804-6055d7ee8907', 'volume_name': 'volume-653e2bdb-1617-441f-9804-6055d7ee8907', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfcd744-6140-41a0-81bc-4aee70dd65d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfcd744-6140-41a0-81bc-4aee70dd65d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c154ff82-a0cd-472f-bd0c-d147ec1c2e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:03 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Volume 653e2bdb-1617-441f-9804-6055d7ee8907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653e2bdb-1617-441f-9804-6055d7ee8907', 'volume_size': 1} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-974121909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653e2bdb-1617-441f-9804-6055d7ee8907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39350b46d13542e7bb123402fe17b946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:03Z,use_quota=True,user_id='5678eb19ebaf4a0ab58583a6488b98c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Creating volume 653e2bdb-1617-441f-9804-6055d7ee8907 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:03 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:03 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 1073741824 Apr 28 00:03:03 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:03 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 1073741824" returned: 0 in 0.599s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:04 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 Apr 28 00:03:04 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:04 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907" returned: 0 in 0.432s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:UPDATE=63,cinder:SELECT=57,cinder:DELETE=6,cinder:INSERT=11 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c154ff82-a0cd-472f-bd0c-d147ec1c2e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653e2bdb-1617-441f-9804-6055d7ee8907', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf59dc20-76d5-4cfe-a44e-8bc59dba32c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=63,cinder:INSERT=27,cinder:UPDATE=86,cinder:DELETE=7 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:03:04 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Volume volume-653e2bdb-1617-441f-9804-6055d7ee8907 (653e2bdb-1617-441f-9804-6055d7ee8907): created successfully Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf59dc20-76d5-4cfe-a44e-8bc59dba32c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Flow 'volume_create_manager' (5a8db172-8084-45b5-a79e-9a924ccc61a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:04 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1fcbcf20-7414-4e3e-adf0-dd1bf55a575c tempest-CinderUnicodeTest-821519063 None] Created volume successfully. Apr 28 00:03:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Creating offline snapshot b9994194-ef65-4ef7-8eec-684b218d0693 of volume 653e2bdb-1617-441f-9804-6055d7ee8907 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:03:05 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8418ce23-84b4-41df-8ef1-fb3885549b49]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:05 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 Apr 28 00:03:05 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:06 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907" returned: 0 in 0.558s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:06 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 1G Apr 28 00:03:06 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:06 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 1G" returned: 0 in 0.569s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653e2bdb-1617-441f-9804-6055d7ee8907 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:06 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653e2bdb-1617-441f-9804-6055d7ee8907 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 Apr 28 00:03:06 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:07 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-653e2bdb-1617-441f-9804-6055d7ee8907 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:07 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 is being set with open permissions: ugo+rw Apr 28 00:03:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:07 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 Apr 28 00:03:07 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:07 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693" returned: 0 in 0.424s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:07 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.info Apr 28 00:03:07 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:08 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.info" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:08 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.info is being set with open permissions: ugo+rw Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:08 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.info Apr 28 00:03:08 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:08 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.info" returned: 0 in 0.427s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.969s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:08 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-aeb60d72-44c1-40aa-8aa5-f0ee2dfdd375 tempest-CinderUnicodeTest-821519063 None] Create snapshot completed successfully Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Acquiring lock "cinder-b9994194-ef65-4ef7-8eec-684b218d0693-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-b9994194-ef65-4ef7-8eec-684b218d0693-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Acquiring lock "cinder-quobyte-653e2bdb-1617-441f-9804-6055d7ee8907" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-quobyte-653e2bdb-1617-441f-9804-6055d7ee8907" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Acquiring lock "cinder-quobyte-b9994194-ef65-4ef7-8eec-684b218d0693" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-quobyte-b9994194-ef65-4ef7-8eec-684b218d0693" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Deleting offline snapshot b9994194-ef65-4ef7-8eec-684b218d0693 of volume 653e2bdb-1617-441f-9804-6055d7ee8907 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] snapshot_file for this snap is: volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2845cb-9a94-4cbe-a0af-7ccfd2f045b1]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:09 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 Apr 28 00:03:09 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:09 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693" returned: 0 in 0.504s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-653e2bdb-1617-441f-9804-6055d7ee8907(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:03:09 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d69d530-9051-43b0-90f0-188a54a77b78]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:09 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 Apr 28 00:03:09 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:09 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907" returned: 0 in 0.499s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:09 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 Apr 28 00:03:09 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:10 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693" returned: 0 in 0.525s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:10 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693 Apr 28 00:03:10 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:10 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907.b9994194-ef65-4ef7-8eec-684b218d0693" returned: 0 in 0.433s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-quobyte-b9994194-ef65-4ef7-8eec-684b218d0693" released by "_delete_snapshot" :: held 2.061s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-quobyte-653e2bdb-1617-441f-9804-6055d7ee8907" released by "delete_snapshot" :: held 2.086s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:11 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Created reservations ['c47ab1e2-447e-4cf3-b39a-a238a37ac416', 'f8b2671c-ce7e-4291-9801-6d7950e72455', 'd357f569-280c-4edb-afea-92f26719bac3', 'a8491ab5-861d-4ce6-ae60-6e1f52fa1807'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Delete snapshot completed successfully. Apr 28 00:03:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-eb166968-e586-4d1e-810a-c10b81d22d29 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-b9994194-ef65-4ef7-8eec-684b218d0693-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Acquiring lock "cinder-653e2bdb-1617-441f-9804-6055d7ee8907-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Lock "cinder-653e2bdb-1617-441f-9804-6055d7ee8907-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Acquiring lock "cinder-quobyte-653e2bdb-1617-441f-9804-6055d7ee8907" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Lock "cinder-quobyte-653e2bdb-1617-441f-9804-6055d7ee8907" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:12 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d86139-098a-4b49-903a-5118da78a748]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:12 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 Apr 28 00:03:12 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:12 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907" returned: 0 in 0.499s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:12 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907 Apr 28 00:03:12 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:13 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-653e2bdb-1617-441f-9804-6055d7ee8907" returned: 0 in 0.435s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Lock "cinder-quobyte-653e2bdb-1617-441f-9804-6055d7ee8907" released by "delete_volume" :: held 0.993s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Created reservations ['72929884-7c76-4b37-ba6b-79f5681f4bbf', '8b20ad70-3f58-41ca-a97c-59a17729a676', 'a81fb573-950f-48a6-96ce-67fa4a94997a', '7e323bb4-29fb-4c91-816b-a026ce8801d8'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:13 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:13 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:13 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.441s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:13 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Deleted volume successfully. Apr 28 00:03:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bd85d2dc-db6d-4cfb-8c9e-5a96450e08cb tempest-CinderUnicodeTest-821519063 None] Lock "cinder-653e2bdb-1617-441f-9804-6055d7ee8907-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Acquiring lock "cinder-3766491c-51e8-42f2-ae29-50706ceae08a-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-3766491c-51e8-42f2-ae29-50706ceae08a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Acquiring lock "cinder-quobyte-3766491c-51e8-42f2-ae29-50706ceae08a" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-quobyte-3766491c-51e8-42f2-ae29-50706ceae08a" acquired by "delete_volume" :: waited 0.027s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:14 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e578abf-0e4e-4ac8-a01d-0a32bd48930c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:14 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a Apr 28 00:03:14 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:14 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a" returned: 0 in 0.543s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:14 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:14 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a Apr 28 00:03:14 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:15 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-3766491c-51e8-42f2-ae29-50706ceae08a" returned: 0 in 0.454s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-quobyte-3766491c-51e8-42f2-ae29-50706ceae08a" released by "delete_volume" :: held 1.047s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Created reservations ['fd015c98-c091-4787-a6ae-d2ade4899851', 'b3035aeb-b194-4d93-b100-a5f4280127cc', 'b84550d2-d60d-4b2a-bfb4-055df80e8e4e', '131e3c76-bc15-4355-a5ee-3a9732e19486'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:15 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:15 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:15 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.433s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Deleted volume successfully. Apr 28 00:03:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-329c0e8e-9e8f-493c-b8a0-29b0fd41f909 tempest-CinderUnicodeTest-821519063 None] Lock "cinder-3766491c-51e8-42f2-ae29-50706ceae08a-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:24 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (01871fad-04e5-4b0e-ae4c-98111301bf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2853110e-8870-4fd3-ba57-0f2ab675c324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2853110e-8870-4fd3-ba57-0f2ab675c324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-486147325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8704aac5-5663-4b6f-adcc-1accd8268b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:25Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea74f72-a406-44da-9b2c-7d26b4fb23e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea74f72-a406-44da-9b2c-7d26b4fb23e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82346576-9a8c-4d91-bb7e-c3e7cdaaa176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82346576-9a8c-4d91-bb7e-c3e7cdaaa176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8704aac5-5663-4b6f-adcc-1accd8268b03', 'volume_name': 'volume-8704aac5-5663-4b6f-adcc-1accd8268b03', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1c944d-1224-491e-8111-f4a529a0e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1c944d-1224-491e-8111-f4a529a0e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1f85f7-982a-44c6-a09e-9f09aa472e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume 8704aac5-5663-4b6f-adcc-1accd8268b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8704aac5-5663-4b6f-adcc-1accd8268b03', 'volume_size': 1} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-486147325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8704aac5-5663-4b6f-adcc-1accd8268b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:25Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Creating volume 8704aac5-5663-4b6f-adcc-1accd8268b03 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:25 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Flow 'volume_create_manager' (46aeb4ef-595a-43d7-8baf-6a705209999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cf56b2-d0be-485e-b1ab-61b0bb84c7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 1073741824 Apr 28 00:03:25 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cf56b2-d0be-485e-b1ab-61b0bb84c7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1731022174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8849be9-f4cd-4d16-964a-5dcfe146be3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de53300844a6428281a8591d6ee15089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:25Z,use_quota=True,user_id='78de2580b3354e53b50d4b1db46f5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e506dc66-9168-43da-b950-4d28e843bb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e506dc66-9168-43da-b950-4d28e843bb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2264de90-3634-4017-b90b-43d56ccecab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2264de90-3634-4017-b90b-43d56ccecab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8849be9-f4cd-4d16-964a-5dcfe146be3e', 'volume_name': 'volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77981285-d82d-49f3-92c7-78a4335f878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77981285-d82d-49f3-92c7-78a4335f878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd99fda-3dfa-4007-9fda-e11f1537d921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Volume e8849be9-f4cd-4d16-964a-5dcfe146be3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e', 'volume_size': 1} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (82eb8fd1-b6f5-423f-9aa2-a3bb5efea9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28236bf-4bad-4570-8f45-72688f467438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28236bf-4bad-4570-8f45-72688f467438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262957085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:25Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc8c3d2-6c72-4fde-bbb9-af30940de851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc8c3d2-6c72-4fde-bbb9-af30940de851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0834ff6b-d9a0-43a1-9e05-400802191bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0834ff6b-d9a0-43a1-9e05-400802191bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea', 'volume_name': 'volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c7e91e-ade3-4d17-9f61-5081577d64b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c7e91e-ade3-4d17-9f61-5081577d64b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc33847-1504-4ba8-b7d0-072a78006476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Volume e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea', 'volume_size': 1} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (94483de8-b170-499d-9773-7622c36e4e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63731f31-9b70-4ef5-bcb1-4a1dad1d9213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63731f31-9b70-4ef5-bcb1-4a1dad1d9213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932108640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011e6a9a-461e-4096-be0a-7745cb0bd6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:26Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1a0dd0-9777-4e2f-ab43-98ea02bc52e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1a0dd0-9777-4e2f-ab43-98ea02bc52e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eac626-8058-4acf-9264-91ce73119427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eac626-8058-4acf-9264-91ce73119427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011e6a9a-461e-4096-be0a-7745cb0bd6ad', 'volume_name': 'volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fd44b2-1bec-42f1-b1fe-87c56e76bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fd44b2-1bec-42f1-b1fe-87c56e76bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f77913a-03c2-47df-9955-53f69c37c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:25 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Volume 011e6a9a-461e-4096-be0a-7745cb0bd6ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad', 'volume_size': 1} Apr 28 00:03:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (a17640a4-45fb-4d84-875e-d2c42a4a958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efdf451-cbb8-48ec-9f42-cd4c1fda8bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efdf451-cbb8-48ec-9f42-cd4c1fda8bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2047204124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f844de08-0055-4ddb-a29d-282ad9908ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:26Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c880ca-f213-46f4-bcf2-7b3c79b58169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c880ca-f213-46f4-bcf2-7b3c79b58169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aceadd0-afab-4208-b3b6-f336338e405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aceadd0-afab-4208-b3b6-f336338e405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f844de08-0055-4ddb-a29d-282ad9908ed0', 'volume_name': 'volume-f844de08-0055-4ddb-a29d-282ad9908ed0', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44761910-65d4-457a-8136-da1d2a7ce3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44761910-65d4-457a-8136-da1d2a7ce3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a338a8e4-549f-411a-a13f-a5fa11223558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Volume f844de08-0055-4ddb-a29d-282ad9908ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f844de08-0055-4ddb-a29d-282ad9908ed0', 'volume_size': 1} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:26 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 1073741824" returned: 0 in 1.069s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:26 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 Apr 28 00:03:26 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (dd7366ed-d4c6-408f-b126-19bfac7365d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c850a5-a9d1-41a7-b5d6-eafa8e7da034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c850a5-a9d1-41a7-b5d6-eafa8e7da034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209356008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e21382-cc38-4bdd-85aa-ac4cc129af39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:26Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cefba363-2fd0-456e-8346-85b8206c3119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cefba363-2fd0-456e-8346-85b8206c3119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b76ce5-de3c-4b2d-9ea3-04e3d365ea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b76ce5-de3c-4b2d-9ea3-04e3d365ea23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e21382-cc38-4bdd-85aa-ac4cc129af39', 'volume_name': 'volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e5631d-b27f-45ac-bc58-595ba445c0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e5631d-b27f-45ac-bc58-595ba445c0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfec5e9-222f-43b0-9a48-73c82ecc4df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Volume f6e21382-cc38-4bdd-85aa-ac4cc129af39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39', 'volume_size': 1} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (e72bdebf-ecbe-4d8b-ab4c-d75f119271a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ca1bca-fe10-4404-94bd-bb5984c65dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ca1bca-fe10-4404-94bd-bb5984c65dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-457804258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:27Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0568c968-f7ca-47fc-8022-0bb75d07cc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0568c968-f7ca-47fc-8022-0bb75d07cc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f514f97-8708-453e-b2fa-81a27ce08329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f514f97-8708-453e-b2fa-81a27ce08329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7', 'volume_name': 'volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44085d9-3a28-4e71-ad70-fa91419405e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44085d9-3a28-4e71-ad70-fa91419405e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a76632-e788-4dd7-8708-f228d7eac05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Volume ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7', 'volume_size': 1} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:26 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03" returned: 0 in 0.554s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1731022174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8849be9-f4cd-4d16-964a-5dcfe146be3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de53300844a6428281a8591d6ee15089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:25Z,use_quota=True,user_id='78de2580b3354e53b50d4b1db46f5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Creating volume e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:26 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1f85f7-982a-44c6-a09e-9f09aa472e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8704aac5-5663-4b6f-adcc-1accd8268b03', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e 1073741824 Apr 28 00:03:26 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78f8b79-9a7f-4bbb-9854-bf913a98151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:26 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume volume-8704aac5-5663-4b6f-adcc-1accd8268b03 (8704aac5-5663-4b6f-adcc-1accd8268b03): created successfully Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78f8b79-9a7f-4bbb-9854-bf913a98151c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:26 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (01871fad-04e5-4b0e-ae4c-98111301bf82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:26 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f2c5da9f-0942-480e-a0d7-65baf81ae27f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created volume successfully. Apr 28 00:03:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:27 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e 1073741824" returned: 0 in 0.738s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:27 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e Apr 28 00:03:27 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:28 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e" returned: 0 in 0.480s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.601s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262957085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:25Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Creating volume e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:28 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd99fda-3dfa-4007-9fda-e11f1537d921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:28 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea 1073741824 Apr 28 00:03:28 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03994abe-484b-40b6-afb8-e5d80dc3168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:28 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Volume volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e (e8849be9-f4cd-4d16-964a-5dcfe146be3e): created successfully Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03994abe-484b-40b6-afb8-e5d80dc3168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Flow 'volume_create_manager' (46aeb4ef-595a-43d7-8baf-6a705209999c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:28 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-a60d7038-5c54-4236-ac31-e2eb18f01b79 tempest-VolumeDependencyTests-1699532391 None] Created volume successfully. Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:28 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea 1073741824" returned: 0 in 0.685s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:28 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea Apr 28 00:03:28 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:29 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea" returned: 0 in 0.439s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.425s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932108640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011e6a9a-461e-4096-be0a-7745cb0bd6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:26Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Creating volume 011e6a9a-461e-4096-be0a-7745cb0bd6ad {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:29 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc33847-1504-4ba8-b7d0-072a78006476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:29 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad 1073741824 Apr 28 00:03:29 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2757f6be-d4ba-4381-ae3b-1afbd14d603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:29 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Volume volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea (e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea): created successfully Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2757f6be-d4ba-4381-ae3b-1afbd14d603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (82eb8fd1-b6f5-423f-9aa2-a3bb5efea9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:29 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1cf881d8-254a-451f-934e-987d4063b1b8 tempest-CreateVolumesFromImageTest-1490589814 None] Created volume successfully. Apr 28 00:03:29 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad 1073741824" returned: 0 in 0.753s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:30 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad Apr 28 00:03:30 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:30 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad" returned: 0 in 0.493s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.386s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2047204124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f844de08-0055-4ddb-a29d-282ad9908ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:26Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Creating volume f844de08-0055-4ddb-a29d-282ad9908ed0 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:30 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f77913a-03c2-47df-9955-53f69c37c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004bfefd-8085-455f-b69d-f0c01084084e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:30 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0 1073741824 Apr 28 00:03:30 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:30 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Volume volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad (011e6a9a-461e-4096-be0a-7745cb0bd6ad): created successfully Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004bfefd-8085-455f-b69d-f0c01084084e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:30 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (94483de8-b170-499d-9773-7622c36e4e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:30 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b650259d-4d0a-49a7-8641-daa53049ef73 tempest-CreateVolumesFromImageTest-1490589814 None] Created volume successfully. Apr 28 00:03:31 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0 1073741824" returned: 0 in 0.697s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:31 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0 Apr 28 00:03:31 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:31 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.294s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209356008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e21382-cc38-4bdd-85aa-ac4cc129af39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:26Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Creating volume f6e21382-cc38-4bdd-85aa-ac4cc129af39 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:31 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:31 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 1073741824 Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a338a8e4-549f-411a-a13f-a5fa11223558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f844de08-0055-4ddb-a29d-282ad9908ed0', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:31 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72123c6-d5bc-4543-b8fe-c02ed497207b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:31 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Volume volume-f844de08-0055-4ddb-a29d-282ad9908ed0 (f844de08-0055-4ddb-a29d-282ad9908ed0): created successfully Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72123c6-d5bc-4543-b8fe-c02ed497207b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:31 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (a17640a4-45fb-4d84-875e-d2c42a4a958a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:31 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ebd89659-93f1-47e4-adc7-2691e35986da tempest-CreateVolumesFromImageTest-1490589814 None] Created volume successfully. Apr 28 00:03:32 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 1073741824" returned: 0 in 0.761s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:32 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 Apr 28 00:03:32 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:33 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39" returned: 0 in 0.515s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.344s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-457804258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6884f322d54743e8b75ba4cb061632ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:27Z,use_quota=True,user_id='239aa1a9e3e94fbc98d22b16682cd860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Creating volume ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:33 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfec5e9-222f-43b0-9a48-73c82ecc4df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c754af0-4e13-43b2-8007-a79b4cb2df69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:33 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 1073741824 Apr 28 00:03:33 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:33 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Volume volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 (f6e21382-cc38-4bdd-85aa-ac4cc129af39): created successfully Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c754af0-4e13-43b2-8007-a79b4cb2df69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (dd7366ed-d4c6-408f-b126-19bfac7365d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:33 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-04597247-409a-4d83-8078-5647a9fe02a3 tempest-CreateVolumesFromImageTest-1490589814 None] Created volume successfully. Apr 28 00:03:33 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 1073741824" returned: 0 in 0.766s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:33 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 Apr 28 00:03:33 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:34 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7" returned: 0 in 0.480s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.909s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a76632-e788-4dd7-8708-f228d7eac05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b2199b-5bc9-4444-945e-6627d6b3efe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Creating offline snapshot 34938e93-d94b-4783-a3c2-f52a067907bc of volume 8704aac5-5663-4b6f-adcc-1accd8268b03 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:03:34 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Volume volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 (ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7): created successfully Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b2199b-5bc9-4444-945e-6627d6b3efe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Flow 'volume_create_manager' (e72bdebf-ecbe-4d8b-ab4c-d75f119271a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb8734-8eb3-4718-92c0-783d0a995869]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-77f18af0-f59f-4ca2-b5c8-8549ff619bd1 tempest-CreateVolumesFromImageTest-1490589814 None] Created volume successfully. Apr 28 00:03:34 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 Apr 28 00:03:34 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:34 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03" returned: 0 in 0.602s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:35 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc 1G Apr 28 00:03:35 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-quobyte-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:35 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dfb50d-fa51-4951-8172-40f65dfa575a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:35 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 Apr 28 00:03:35 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:35 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc 1G" returned: 0 in 0.727s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8704aac5-5663-4b6f-adcc-1accd8268b03 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:35 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8704aac5-5663-4b6f-adcc-1accd8268b03 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc Apr 28 00:03:35 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:36 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7" returned: 0 in 0.627s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:36 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7 Apr 28 00:03:36 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:36 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8704aac5-5663-4b6f-adcc-1accd8268b03 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc" returned: 0 in 0.616s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:36 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc is being set with open permissions: ugo+rw Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:36 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc Apr 28 00:03:36 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:36 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7" returned: 0 in 0.558s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7" released by "delete_volume" :: held 1.233s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Created reservations ['cc863ab5-ac81-4e54-8cc8-5f2076c6a2f5', '3145ab5b-af12-4fb5-90dc-a6913cae986d', 'ba43ffd6-b03b-494a-8998-84753ee7ebd1', 'f9ea0bfa-0ab9-4d4c-ae82-7191a77a7007'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:36 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc" returned: 0 in 0.539s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:36 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.info Apr 28 00:03:36 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:36 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:36 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:37 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.info" returned: 0 in 0.524s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:37 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.info is being set with open permissions: ugo+rw Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:37 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.info Apr 28 00:03:37 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:37 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.532s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:37 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Deleted volume successfully. Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2342c7a0-3f87-4c47-905b-d04059981c7e tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-ef24d1e0-b0e1-43ca-9cb3-ec8638dcfbb7-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-f6e21382-cc38-4bdd-85aa-ac4cc129af39-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-f6e21382-cc38-4bdd-85aa-ac4cc129af39-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-quobyte-f6e21382-cc38-4bdd-85aa-ac4cc129af39" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-f6e21382-cc38-4bdd-85aa-ac4cc129af39" acquired by "delete_volume" :: waited 0.039s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da77dbd-ea20-4e30-bad7-68468d129f24]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:37 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 Apr 28 00:03:37 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:37 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.info" returned: 0 in 0.513s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.641s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.448s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Creating offline snapshot 255711e3-c71f-47a9-8dd1-35ba19f1e8b6 of volume e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:03:38 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-509d2fc5-de29-4835-9f4b-fdd779ffd81a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Create snapshot completed successfully Apr 28 00:03:38 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[180c8f47-c3d2-4c89-b87f-59ec1903f7c9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:38 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e Apr 28 00:03:38 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:38 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39" returned: 0 in 0.616s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:38 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39 Apr 28 00:03:38 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:38 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e" returned: 0 in 0.670s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:38 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 1G Apr 28 00:03:38 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:38 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f6e21382-cc38-4bdd-85aa-ac4cc129af39" returned: 0 in 0.482s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-f6e21382-cc38-4bdd-85aa-ac4cc129af39" released by "delete_volume" :: held 1.137s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Created reservations ['31236041-2fb1-43e1-b415-bc852ab657a5', '9c1c1240-bea4-4c43-b4bd-5daf120f019f', 'd9760373-e090-4409-a2b4-4ffb8c4f8a50', 'df86d43f-da15-42b3-a21f-ccac84a21b12'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:39 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:39 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (534c437c-fd29-4149-b4da-7fa51fcc31c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025558e9-0aa4-42a8-b79c-fed50d026e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025558e9-0aa4-42a8-b79c-fed50d026e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721908137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b4674a-dbbb-4deb-b945-12635ad0376e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:39Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf875ff-d342-4f8e-92d9-91a3926b0ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf875ff-d342-4f8e-92d9-91a3926b0ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdf77dc-44d8-4cf0-905b-82a2e995af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdf77dc-44d8-4cf0-905b-82a2e995af41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b4674a-dbbb-4deb-b945-12635ad0376e', 'volume_name': 'volume-03b4674a-dbbb-4deb-b945-12635ad0376e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5072a9-2d32-4f3e-a588-06966d1a637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5072a9-2d32-4f3e-a588-06966d1a637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bda5f3-3100-449d-9dbe-9e5e3afa7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume 03b4674a-dbbb-4deb-b945-12635ad0376e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b4674a-dbbb-4deb-b945-12635ad0376e', 'volume_size': 1} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:39 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 1G" returned: 0 in 0.907s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:39 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 Apr 28 00:03:39 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:39 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (d3fd322e-2ae6-4113-abb8-262e3d7f81ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e349ea1a-2056-47fa-8984-f9ea64c1a8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e349ea1a-2056-47fa-8984-f9ea64c1a8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1149146796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23624296-be15-4d29-bf66-fa673919789e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:40Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724c0d67-a0aa-4213-a7f5-e017fd3c3276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724c0d67-a0aa-4213-a7f5-e017fd3c3276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76777ecd-02ee-4df7-92bb-34f1fc560721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76777ecd-02ee-4df7-92bb-34f1fc560721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23624296-be15-4d29-bf66-fa673919789e', 'volume_name': 'volume-23624296-be15-4d29-bf66-fa673919789e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d4ea87-9d84-4f33-8740-66346df37848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d4ea87-9d84-4f33-8740-66346df37848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b198d58-610a-4a8e-91b6-17d1af5fe9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:39 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume 23624296-be15-4d29-bf66-fa673919789e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23624296-be15-4d29-bf66-fa673919789e', 'volume_size': 1} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.807s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:39 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Deleted volume successfully. Apr 28 00:03:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6417ef7e-fa77-49a0-bffd-92bc6ed1dd48 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-f6e21382-cc38-4bdd-85aa-ac4cc129af39-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-f844de08-0055-4ddb-a29d-282ad9908ed0-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (627fde60-a121-46ff-9ed9-74471dba2330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b940cc5e-4b6e-40c9-a370-3b2460f3340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-f844de08-0055-4ddb-a29d-282ad9908ed0-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b940cc5e-4b6e-40c9-a370-3b2460f3340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-311222834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9361e6-95df-4c41-bed3-daa121b210d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:40Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc815b1-36ed-4c45-8b84-81c38138dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc815b1-36ed-4c45-8b84-81c38138dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeca2a2-fc4e-41d5-b94d-9636078cf429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeca2a2-fc4e-41d5-b94d-9636078cf429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9361e6-95df-4c41-bed3-daa121b210d0', 'volume_name': 'volume-7f9361e6-95df-4c41-bed3-daa121b210d0', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77582695-069d-4388-8c2c-1cfefa824ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77582695-069d-4388-8c2c-1cfefa824ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb604e96-7bc8-40f2-8fa0-98db972e471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume 7f9361e6-95df-4c41-bed3-daa121b210d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9361e6-95df-4c41-bed3-daa121b210d0', 'volume_size': 1} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-quobyte-f844de08-0055-4ddb-a29d-282ad9908ed0" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-f844de08-0055-4ddb-a29d-282ad9908ed0" acquired by "delete_volume" :: waited 0.027s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7158c90-7f72-40d1-8345-820cc6218005]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:40 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6" returned: 0 in 0.865s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:40 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 is being set with open permissions: ugo+rw Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:40 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 Apr 28 00:03:40 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:40 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0 Apr 28 00:03:40 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (869f07bd-fef3-4985-ab46-260dbfd5d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a8f766-d635-485e-9dfd-45d376a4b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a8f766-d635-485e-9dfd-45d376a4b60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333867176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec9b858-cefc-4647-98b4-12f3a7cda036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:41Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6da304-ad52-48e8-81ce-b90d9a305820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6da304-ad52-48e8-81ce-b90d9a305820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00929752-1cba-4a7e-8eb5-db53674c2de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00929752-1cba-4a7e-8eb5-db53674c2de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec9b858-cefc-4647-98b4-12f3a7cda036', 'volume_name': 'volume-bec9b858-cefc-4647-98b4-12f3a7cda036', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65df2bb9-c21c-49b4-81d8-7448f454d897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65df2bb9-c21c-49b4-81d8-7448f454d897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e949fb9-ab6e-4a77-a5b0-b09840fba65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:40 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume bec9b858-cefc-4647-98b4-12f3a7cda036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec9b858-cefc-4647-98b4-12f3a7cda036', 'volume_size': 1} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:40 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (5c27f89b-8622-4353-939e-71de69c273c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cdc1c4-35c6-4ee2-b1f3-479cd33eb8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cdc1c4-35c6-4ee2-b1f3-479cd33eb8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480686930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebeb5212-7fdd-4afc-8311-a6e981fde973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:41Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f4d19f-ceca-4501-b154-2ccee66bd0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f4d19f-ceca-4501-b154-2ccee66bd0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:41 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf929e1b-0590-440a-b695-c4ef67ae1de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf929e1b-0590-440a-b695-c4ef67ae1de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebeb5212-7fdd-4afc-8311-a6e981fde973', 'volume_name': 'volume-ebeb5212-7fdd-4afc-8311-a6e981fde973', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711a2fcb-1e79-4ad0-b9db-5a195e739cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711a2fcb-1e79-4ad0-b9db-5a195e739cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209e2ba4-46ee-422f-a688-d61f5f76dd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:41 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume ebeb5212-7fdd-4afc-8311-a6e981fde973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebeb5212-7fdd-4afc-8311-a6e981fde973', 'volume_size': 1} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6" returned: 0 in 0.656s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:41 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.info Apr 28 00:03:41 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:41 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0" returned: 0 in 0.995s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:41 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0 Apr 28 00:03:41 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:41 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.info" returned: 0 in 0.585s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:41 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.info is being set with open permissions: ugo+rw Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:41 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.info Apr 28 00:03:41 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:41 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-f844de08-0055-4ddb-a29d-282ad9908ed0" returned: 0 in 0.477s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-f844de08-0055-4ddb-a29d-282ad9908ed0" released by "delete_volume" :: held 1.541s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Created reservations ['409803af-37ed-40d5-8ffb-d3e8fa5e3799', '79833314-f26c-4664-8846-dcfe3da997f6', 'f90f0446-70da-49f7-9477-02c39032d65a', '139d84f5-8f1f-4afc-a065-7d78f641f149'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:41 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:41 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-011e6a9a-461e-4096-be0a-7745cb0bd6ad-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:42 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-011e6a9a-461e-4096-be0a-7745cb0bd6ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.info" returned: 0 in 0.688s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.502s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.996s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721908137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b4674a-dbbb-4deb-b945-12635ad0376e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:39Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Creating volume 03b4674a-dbbb-4deb-b945-12635ad0376e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:42 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-quobyte-011e6a9a-461e-4096-be0a-7745cb0bd6ad" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:42 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-14e719fa-aff0-4a0c-8386-50907313f72c tempest-VolumeDependencyTests-1699532391 None] Create snapshot completed successfully Apr 28 00:03:42 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:42 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e 1073741824 Apr 28 00:03:42 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.642s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-011e6a9a-461e-4096-be0a-7745cb0bd6ad" acquired by "delete_volume" :: waited 0.037s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:42 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Deleted volume successfully. Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c161ef-ea66-4042-b763-d0226d29a18c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-52084456-ef22-4004-b73b-ff311a205bf2 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-f844de08-0055-4ddb-a29d-282ad9908ed0-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:42 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad Apr 28 00:03:42 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:43 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e 1073741824" returned: 0 in 0.935s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:43 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e Apr 28 00:03:43 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:43 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad" returned: 0 in 0.927s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:43 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad Apr 28 00:03:43 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:43 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:43 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Flow 'volume_create_manager' (ccec841f-6c0f-40ff-97b0-8dac46eae3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40630009-cba3-4e10-a66e-87b88e39f931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40630009-cba3-4e10-a66e-87b88e39f931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1021203144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214d0baf-66fc-4214-bcd1-1748d0aad33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de53300844a6428281a8591d6ee15089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=255711e3-c71f-47a9-8dd1-35ba19f1e8b6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:44Z,use_quota=True,user_id='78de2580b3354e53b50d4b1db46f5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d84ca15-a76f-4c8f-a7e0-e7d111cd9602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d84ca15-a76f-4c8f-a7e0-e7d111cd9602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bdcf77-901f-4123-a8e9-ecf7e46a7b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bdcf77-901f-4123-a8e9-ecf7e46a7b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '214d0baf-66fc-4214-bcd1-1748d0aad33c', 'volume_name': 'volume-214d0baf-66fc-4214-bcd1-1748d0aad33c', 'volume_size': 1, 'snapshot_id': '255711e3-c71f-47a9-8dd1-35ba19f1e8b6'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf50c6c-338b-4ed4-8b3d-eb703375051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf50c6c-338b-4ed4-8b3d-eb703375051e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643e563f-2c97-46fb-a14f-f785f7025e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:44 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Volume 214d0baf-66fc-4214-bcd1-1748d0aad33c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-214d0baf-66fc-4214-bcd1-1748d0aad33c', 'volume_size': 1, 'snapshot_id': '255711e3-c71f-47a9-8dd1-35ba19f1e8b6'} Apr 28 00:03:44 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e" returned: 0 in 0.642s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.214s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1149146796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23624296-be15-4d29-bf66-fa673919789e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:40Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Creating volume 23624296-be15-4d29-bf66-fa673919789e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:44 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bda5f3-3100-449d-9dbe-9e5e3afa7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b4674a-dbbb-4deb-b945-12635ad0376e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cea6fea-eef6-4f80-be80-26a8fa575c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:44 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e 1073741824 Apr 28 00:03:44 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:44 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume volume-03b4674a-dbbb-4deb-b945-12635ad0376e (03b4674a-dbbb-4deb-b945-12635ad0376e): created successfully Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cea6fea-eef6-4f80-be80-26a8fa575c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (534c437c-fd29-4149-b4da-7fa51fcc31c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:44 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-15c50f37-ede9-4dc6-9ac9-64c92ad069ae tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created volume successfully. Apr 28 00:03:44 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-011e6a9a-461e-4096-be0a-7745cb0bd6ad" returned: 0 in 0.706s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-011e6a9a-461e-4096-be0a-7745cb0bd6ad" released by "delete_volume" :: held 1.704s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Created reservations ['ba34a4b4-e045-434e-a63c-ca4d75c05a3f', '757a7df1-204a-4667-a5b3-6ba25838d072', 'a17eb97a-2ba8-4cac-a09b-8af68d0f9155', 'ff2c3a1d-5903-4c00-b1ee-2ba881ac16e8'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:44 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:44 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "cinder-quobyte-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[42949fe2-9609-45d6-bd09-30cf890df4c8]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:45 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e 1073741824" returned: 0 in 0.974s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:45 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.725s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:45 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea Apr 28 00:03:45 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Deleted volume successfully. Apr 28 00:03:45 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:45 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:45 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-b801ce0f-8023-4852-8e0f-5b927359cfaa tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-011e6a9a-461e-4096-be0a-7745cb0bd6ad-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:45 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e Apr 28 00:03:45 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:45 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.613s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:45 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea" returned: 0 in 0.931s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:45 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea Apr 28 00:03:45 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:45 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Flow 'volume_create_manager' (478206fb-5289-4e5f-83fc-837baba3ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef9b8b3-85da-4c76-8924-ce626a4b10d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef9b8b3-85da-4c76-8924-ce626a4b10d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-312066064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22d2e4c-9ec6-4b31-ad8e-717e1959be5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07659edfca434294a526674b2d460c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:46Z,use_quota=True,user_id='309caa5f254448e98b42d99dd74c161f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f38bf3-9557-46d5-8c9e-d8c2e27a5038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:45 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f38bf3-9557-46d5-8c9e-d8c2e27a5038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f38828c-9cb8-4acd-8b4c-f3c3a47cbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f38828c-9cb8-4acd-8b4c-f3c3a47cbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22d2e4c-9ec6-4b31-ad8e-717e1959be5e', 'volume_name': 'volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49758ebd-a5a0-490f-a62e-0d2eccfc935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49758ebd-a5a0-490f-a62e-0d2eccfc935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7e1d72-b0c8-4b73-9bd1-cff89ecb30e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:46 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Volume d22d2e4c-9ec6-4b31-ad8e-717e1959be5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e', 'volume_size': 1} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e" returned: 0 in 0.847s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.849s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-311222834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9361e6-95df-4c41-bed3-daa121b210d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:40Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Creating volume 7f9361e6-95df-4c41-bed3-daa121b210d0 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:46 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b198d58-610a-4a8e-91b6-17d1af5fe9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23624296-be15-4d29-bf66-fa673919789e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1306020c-bc61-4bb1-bfe9-78c32a6e2d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:46 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0 1073741824 Apr 28 00:03:46 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:46 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume volume-23624296-be15-4d29-bf66-fa673919789e (23624296-be15-4d29-bf66-fa673919789e): created successfully Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1306020c-bc61-4bb1-bfe9-78c32a6e2d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (d3fd322e-2ae6-4113-abb8-262e3d7f81ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:46 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-d5d5d8c9-5f3c-4425-81ec-903ed19b762b tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created volume successfully. Apr 28 00:03:46 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea" returned: 0 in 0.485s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-quobyte-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea" released by "delete_volume" :: held 1.469s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Created reservations ['4d7dbc5a-db17-42fc-9dbc-919df855c06e', 'b3c5dc4e-1e37-46e7-99e1-311c92a4a5d3', 'e0c7d6df-d57f-408e-899f-b2bf32b57d5b', '67d309a9-8833-4876-ad07-0a24de6deda3'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:46 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:46 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:46 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0 1073741824" returned: 0 in 0.667s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:46 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0 Apr 28 00:03:46 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:47 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.458s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:47 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Deleted volume successfully. Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-bb3b83ac-d2d3-489f-9e17-b338ffd91314 tempest-CreateVolumesFromImageTest-1490589814 None] Lock "cinder-e8ae77c3-bde4-4cb1-9d2b-13115d7ebeea-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:47 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0" returned: 0 in 0.471s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.462s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333867176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec9b858-cefc-4647-98b4-12f3a7cda036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:41Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Creating volume bec9b858-cefc-4647-98b4-12f3a7cda036 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:47 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb604e96-7bc8-40f2-8fa0-98db972e471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9361e6-95df-4c41-bed3-daa121b210d0', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:47 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036 1073741824 Apr 28 00:03:47 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a98048-c33a-402e-81be-f6a43128fd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:47 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume volume-7f9361e6-95df-4c41-bed3-daa121b210d0 (7f9361e6-95df-4c41-bed3-daa121b210d0): created successfully Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a98048-c33a-402e-81be-f6a43128fd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (627fde60-a121-46ff-9ed9-74471dba2330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:47 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0fca119f-d7c1-44e9-9ae1-3a5b2dee2814 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created volume successfully. Apr 28 00:03:47 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036 1073741824" returned: 0 in 0.743s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:48 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036 Apr 28 00:03:48 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:48 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036" returned: 0 in 0.514s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.432s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480686930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebeb5212-7fdd-4afc-8311-a6e981fde973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612311b858554d35b2ef45819187c83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:41Z,use_quota=True,user_id='2695fddbd2644f5ca359774bb466d7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Creating volume ebeb5212-7fdd-4afc-8311-a6e981fde973 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:48 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e949fb9-ab6e-4a77-a5b0-b09840fba65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec9b858-cefc-4647-98b4-12f3a7cda036', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:48 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 1073741824 Apr 28 00:03:48 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d05f5c3-39df-42fd-b355-4759e36985aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:48 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume volume-bec9b858-cefc-4647-98b4-12f3a7cda036 (bec9b858-cefc-4647-98b4-12f3a7cda036): created successfully Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d05f5c3-39df-42fd-b355-4759e36985aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:48 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (869f07bd-fef3-4985-ab46-260dbfd5d242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:48 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ba1f1ad4-6852-4170-bf2d-948f4e6aec5e tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created volume successfully. Apr 28 00:03:49 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 1073741824" returned: 0 in 0.721s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:49 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 Apr 28 00:03:49 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (c96853d7-5d54-409e-90a1-2a776786a6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a46f943-905b-4402-b890-75003e479381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:49 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a46f943-905b-4402-b890-75003e479381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732596068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71cc3b15-76e4-4473-ac0d-604860587809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:50Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6895ef77-6f56-4a48-977b-963cf5575f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6895ef77-6f56-4a48-977b-963cf5575f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3b4830-4c62-4e86-9e63-189edb5f7356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3b4830-4c62-4e86-9e63-189edb5f7356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71cc3b15-76e4-4473-ac0d-604860587809', 'volume_name': 'volume-71cc3b15-76e4-4473-ac0d-604860587809', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04671b1-7411-4b7e-9072-8cfc97b92117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04671b1-7411-4b7e-9072-8cfc97b92117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e31cbf-1983-4e8d-b4c4-21f7c9c509ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:49 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume 71cc3b15-76e4-4473-ac0d-604860587809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71cc3b15-76e4-4473-ac0d-604860587809', 'volume_size': 1} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973" returned: 0 in 0.538s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.672s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-255711e3-c71f-47a9-8dd1-35ba19f1e8b6-214d0baf-66fc-4214-bcd1-1748d0aad33c" by "_create_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209e2ba4-46ee-422f-a688-d61f5f76dd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebeb5212-7fdd-4afc-8311-a6e981fde973', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81457acc-567b-4f48-8384-057a2b071670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:49 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Volume volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 (ebeb5212-7fdd-4afc-8311-a6e981fde973): created successfully Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81457acc-567b-4f48-8384-057a2b071670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Flow 'volume_create_manager' (5c27f89b-8622-4353-939e-71de69c273c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:49 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-142ecba3-1c97-49e3-8e6e-b8e0711144d8 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created volume successfully. Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-255711e3-c71f-47a9-8dd1-35ba19f1e8b6-214d0baf-66fc-4214-bcd1-1748d0aad33c" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Creating volume 214d0baf-66fc-4214-bcd1-1748d0aad33c from snapshot 255711e3-c71f-47a9-8dd1-35ba19f1e8b6 {{(pid=81312) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-214d0baf-66fc-4214-bcd1-1748d0aad33c" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-214d0baf-66fc-4214-bcd1-1748d0aad33c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] snapshot: 255711e3-c71f-47a9-8dd1-35ba19f1e8b6, volume: 214d0baf-66fc-4214-bcd1-1748d0aad33c, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[271dcdfc-accd-4692-8412-56f41c70a80b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:49 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:50 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 Apr 28 00:03:50 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:50 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6" returned: 0 in 0.527s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:03:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 00:03:50 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 00:03:50 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c8be2c-9d5f-4d4c-b6f3-c528e50f13de]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:50 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:50 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e Apr 28 00:03:50 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-ebeb5212-7fdd-4afc-8311-a6e981fde973-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:50 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-ebeb5212-7fdd-4afc-8311-a6e981fde973-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-quobyte-ebeb5212-7fdd-4afc-8311-a6e981fde973" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:51 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-ebeb5212-7fdd-4afc-8311-a6e981fde973" acquired by "delete_volume" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:51 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ad5ad-a1b0-4fe1-89d8-0c5bff560a46]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:51 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e" returned: 0 in 0.572s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:51 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 00:03:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:51 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c Apr 28 00:03:51 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:51 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 Apr 28 00:03:51 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:51 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973" returned: 0 in 0.641s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:51 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:51 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973 Apr 28 00:03:51 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:52 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ebeb5212-7fdd-4afc-8311-a6e981fde973" returned: 0 in 0.835s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:52 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-ebeb5212-7fdd-4afc-8311-a6e981fde973" released by "delete_volume" :: held 1.533s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:52 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created reservations ['3312245b-c2e4-4a89-9a7a-95be57badce6', '0e1e07ac-cab8-4453-baa8-074aada30483', '2ce779cf-2660-4b4a-9a35-c74bdfc5c2bc', '0a17fccf-8a01-4439-8c71-763b60826620'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:52 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:52 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:52 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:52 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-bec9b858-cefc-4647-98b4-12f3a7cda036-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-bec9b858-cefc-4647-98b4-12f3a7cda036-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-quobyte-bec9b858-cefc-4647-98b4-12f3a7cda036" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-bec9b858-cefc-4647-98b4-12f3a7cda036" acquired by "delete_volume" :: waited 0.027s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:53 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a60cb6-e205-4da3-9e1f-18fb3a08c89f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:53 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:53 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.062s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:53 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:53 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Deleted volume successfully. Apr 28 00:03:53 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036 Apr 28 00:03:53 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:53 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-211d38e2-d6f5-482c-9bcf-8a9a73a6b4b0 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-ebeb5212-7fdd-4afc-8311-a6e981fde973-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:54 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036" returned: 0 in 1.367s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:54 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:55 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036 Apr 28 00:03:55 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:56 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-bec9b858-cefc-4647-98b4-12f3a7cda036" returned: 0 in 1.193s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-bec9b858-cefc-4647-98b4-12f3a7cda036" released by "delete_volume" :: held 2.646s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created reservations ['0a51d4b9-efc1-4315-a936-b4df84266c7b', 'e40c8c7c-0ae6-4b3d-8177-b84895075a44', 'eb2e389c-97f9-443d-a0c6-9c45d0384110', 'c4837b56-eb0c-41eb-85a2-d41e26c8e783'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:56 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c" returned: 0 in 5.205s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c21402b-b500-42d8-a6db-434e57d46237]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:56 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:56 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:56 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e Apr 28 00:03:56 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:56 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.467s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:56 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Deleted volume successfully. Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-a137c816-cb94-48b4-a6cf-4474c4f95a6f tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-bec9b858-cefc-4647-98b4-12f3a7cda036-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-7f9361e6-95df-4c41-bed3-daa121b210d0-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-7f9361e6-95df-4c41-bed3-daa121b210d0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-quobyte-7f9361e6-95df-4c41-bed3-daa121b210d0" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:56 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-7f9361e6-95df-4c41-bed3-daa121b210d0" acquired by "delete_volume" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:57 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e" returned: 0 in 0.693s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 00:03:57 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Converted 1024.00 MB image at 196.71 MB/s Apr 28 00:03:57 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c is being set with open permissions: ugo+rw Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[d134e249-12a9-414f-aec6-d0ed4bc5b1c4]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:57 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c Apr 28 00:03:57 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:57 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0 Apr 28 00:03:57 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:57 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c" returned: 0 in 0.426s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-214d0baf-66fc-4214-bcd1-1748d0aad33c" released by "_copy_volume_from_snapshot" :: held 7.531s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-255711e3-c71f-47a9-8dd1-35ba19f1e8b6-214d0baf-66fc-4214-bcd1-1748d0aad33c" released by "_create_volume_from_snapshot" :: held 7.568s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.622s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.439s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-312066064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22d2e4c-9ec6-4b31-ad8e-717e1959be5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07659edfca434294a526674b2d460c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:46Z,use_quota=True,user_id='309caa5f254448e98b42d99dd74c161f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Creating volume d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:57 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:57 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e 1073741824 Apr 28 00:03:57 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643e563f-2c97-46fb-a14f-f785f7025e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-214d0baf-66fc-4214-bcd1-1748d0aad33c', 'volume_size': 1, 'snapshot_id': '255711e3-c71f-47a9-8dd1-35ba19f1e8b6'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d4bb3-9bcf-4c29-a893-688f93074e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:57 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:57 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Volume volume-214d0baf-66fc-4214-bcd1-1748d0aad33c (214d0baf-66fc-4214-bcd1-1748d0aad33c): created successfully Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d4bb3-9bcf-4c29-a893-688f93074e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Flow 'volume_create_manager' (ccec841f-6c0f-40ff-97b0-8dac46eae3a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0" returned: 0 in 0.535s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:57 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:57 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0 Apr 28 00:03:57 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:57 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-08def105-ee3b-46fa-ad70-7c53cae54867 tempest-VolumeDependencyTests-1699532391 None] Created volume successfully. Apr 28 00:03:58 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-7f9361e6-95df-4c41-bed3-daa121b210d0" returned: 0 in 0.490s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-7f9361e6-95df-4c41-bed3-daa121b210d0" released by "delete_volume" :: held 1.073s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-255711e3-c71f-47a9-8dd1-35ba19f1e8b6-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:58 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e 1073741824" returned: 0 in 0.657s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-255711e3-c71f-47a9-8dd1-35ba19f1e8b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-e8849be9-f4cd-4d16-964a-5dcfe146be3e" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created reservations ['79741b3c-9a15-4ad0-a075-26c48ebd9605', 'e0a38b21-3a9a-45cc-b108-67dc8bb7b0dd', 'c1749db5-d5f2-458c-a4a5-c20e857fcd9a', 'aca1e4d7-eea2-4a82-ab20-696e5e8d627a'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-e8849be9-f4cd-4d16-964a-5dcfe146be3e" acquired by "delete_snapshot" :: waited 0.040s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-255711e3-c71f-47a9-8dd1-35ba19f1e8b6" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:58 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e Apr 28 00:03:58 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-255711e3-c71f-47a9-8dd1-35ba19f1e8b6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Deleting offline snapshot 255711e3-c71f-47a9-8dd1-35ba19f1e8b6 of volume e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] snapshot_file for this snap is: volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4330d-094a-4c03-80c5-f48db387f159]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:58 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:03:58 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:58 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 Apr 28 00:03:58 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:58 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" returned: 0 in 0.479s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.837s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732596068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71cc3b15-76e4-4473-ac0d-604860587809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:03:50Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Creating volume 71cc3b15-76e4-4473-ac0d-604860587809 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:03:58 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:58 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809 1073741824 Apr 28 00:03:58 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7e1d72-b0c8-4b73-9bd1-cff89ecb30e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf5cb36-3a96-4f24-8ff8-1aa286eedbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:58 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Volume volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e (d22d2e4c-9ec6-4b31-ad8e-717e1959be5e): created successfully Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf5cb36-3a96-4f24-8ff8-1aa286eedbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Flow 'volume_create_manager' (478206fb-5289-4e5f-83fc-837baba3ea14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e31467cd-7a87-4840-b271-8dc5a0e84c00 tempest-SnapshotDependencyTests-774724892 None] Created volume successfully. Apr 28 00:03:58 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.467s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:03:58 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Deleted volume successfully. Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0b070121-ffa7-48f3-b5ee-1005bd8d1f4a tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-7f9361e6-95df-4c41-bed3-daa121b210d0-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:03:58 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6" returned: 0 in 0.554s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9f7b10-9c8c-4320-9a21-576d7398489f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:58 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:58 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e Apr 28 00:03:58 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-23624296-be15-4d29-bf66-fa673919789e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-23624296-be15-4d29-bf66-fa673919789e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-quobyte-23624296-be15-4d29-bf66-fa673919789e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-23624296-be15-4d29-bf66-fa673919789e" acquired by "delete_volume" :: waited 0.011s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5463f0f-2fdd-4534-9aaa-12ee274b912a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:59 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809 1073741824" returned: 0 in 0.706s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:59 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e Apr 28 00:03:59 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:59 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809 Apr 28 00:03:59 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:59 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e" returned: 0 in 0.661s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:59 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 Apr 28 00:03:59 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:59 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e" returned: 0 in 0.538s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:59 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e Apr 28 00:03:59 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:03:59 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.652s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e31cbf-1983-4e8d-b4c4-21f7c9c509ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71cc3b15-76e4-4473-ac0d-604860587809', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27af0fd-2c87-49c6-85aa-0c276291381a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Creating offline snapshot 64510671-8c7d-4f12-85f4-7273c92b5d76 of volume d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:03:59 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume volume-71cc3b15-76e4-4473-ac0d-604860587809 (71cc3b15-76e4-4473-ac0d-604860587809): created successfully Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27af0fd-2c87-49c6-85aa-0c276291381a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (c96853d7-5d54-409e-90a1-2a776786a6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e55cff-3527-4c87-8a35-f9daefb8a8e9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:03:59 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:03:59 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c5e35b87-c4be-46f4-9c87-098e1988b7c4 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created volume successfully. Apr 28 00:04:00 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e Apr 28 00:04:00 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:00 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6" returned: 0 in 0.568s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:00 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6 Apr 28 00:04:00 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:00 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-23624296-be15-4d29-bf66-fa673919789e" returned: 0 in 0.525s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-23624296-be15-4d29-bf66-fa673919789e" released by "delete_volume" :: held 1.104s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created reservations ['2e5bcf66-a9db-4b87-a4ba-506bb352068f', '3f48eab1-17c6-492e-b6c9-a97239797fd4', 'b1af099b-4a68-4fd9-9533-863650e95d90', '89acf6e1-5a79-4d0e-a933-edc6f6ac19c3'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:00 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:00 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:00 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e.255711e3-c71f-47a9-8dd1-35ba19f1e8b6" returned: 0 in 0.504s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:00 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" returned: 0 in 0.676s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-255711e3-c71f-47a9-8dd1-35ba19f1e8b6" released by "_delete_snapshot" :: held 2.417s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-e8849be9-f4cd-4d16-964a-5dcfe146be3e" released by "delete_snapshot" :: held 2.459s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:00 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 1G Apr 28 00:04:00 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Created reservations ['1107139e-a9be-45c2-8041-6ce6d0992289', '5ec53d57-3b7c-4332-abd2-a4b395d48676', 'b61ecb31-28af-485c-8c5e-b2d325f07565', '10dde4ba-f420-425a-8819-a67eaf562eca'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:00 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Delete snapshot completed successfully. Apr 28 00:04:00 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2767f998-da33-4096-8a30-c43f80e3b778 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-255711e3-c71f-47a9-8dd1-35ba19f1e8b6-delete_snapshot" released by "delete_snapshot" :: held 2.613s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:01 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (b7342c71-847e-47b1-a6d2-b827eeffddd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f578ed0-4b1b-4310-93f8-d056017916d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f578ed0-4b1b-4310-93f8-d056017916d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1699074581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3c06b4-e20e-4732-959b-ba7a99d33c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:01Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181e7342-fe7c-4bce-9651-ea211af9afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181e7342-fe7c-4bce-9651-ea211af9afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c644fa-5224-4f40-8722-fd2b27da3cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c644fa-5224-4f40-8722-fd2b27da3cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3c06b4-e20e-4732-959b-ba7a99d33c2b', 'volume_name': 'volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6215265-26de-4190-a1e3-c4adbc47d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6215265-26de-4190-a1e3-c4adbc47d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b3d15e-5fc9-4e6f-a96c-328c94d19292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume ac3c06b4-e20e-4732-959b-ba7a99d33c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b', 'volume_size': 1} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.659s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:01 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Deleted volume successfully. Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-463a18d1-c138-4801-94f0-793bf864ec60 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-23624296-be15-4d29-bf66-fa673919789e-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-e8849be9-f4cd-4d16-964a-5dcfe146be3e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (ca74c185-0fc7-4549-b450-d089afb9f370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4e584a-7c20-4915-9efd-462083a2b8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-e8849be9-f4cd-4d16-964a-5dcfe146be3e-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:01 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4e584a-7c20-4915-9efd-462083a2b8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-735946290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54abf43d-dad3-4612-afbb-6ff486841d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:01Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd37916-c0b2-4c6c-89f3-5209f27dbc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd37916-c0b2-4c6c-89f3-5209f27dbc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6881dd-f79f-4e8b-870d-9e01233b6a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6881dd-f79f-4e8b-870d-9e01233b6a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54abf43d-dad3-4612-afbb-6ff486841d50', 'volume_name': 'volume-54abf43d-dad3-4612-afbb-6ff486841d50', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75729032-7edc-48f0-8eb0-21727ba6a8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75729032-7edc-48f0-8eb0-21727ba6a8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1404ef3a-8c2e-4dee-bddd-bc71f210a00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume 54abf43d-dad3-4612-afbb-6ff486841d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54abf43d-dad3-4612-afbb-6ff486841d50', 'volume_size': 1} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-03b4674a-dbbb-4deb-b945-12635ad0376e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 1G" returned: 0 in 0.850s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-03b4674a-dbbb-4deb-b945-12635ad0376e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-e8849be9-f4cd-4d16-964a-5dcfe146be3e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-e8849be9-f4cd-4d16-964a-5dcfe146be3e" acquired by "delete_volume" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:01 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 Apr 28 00:04:01 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eec438-23a0-4716-ab3c-7d50da401403]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-quobyte-03b4674a-dbbb-4deb-b945-12635ad0376e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-03b4674a-dbbb-4deb-b945-12635ad0376e" acquired by "delete_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed46654-9c5d-4ec2-8181-84d1f741c9b9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:01 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e Apr 28 00:04:01 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:01 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e Apr 28 00:04:01 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (339741d3-dd8c-4087-b83d-c68090e5fba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f285c8e-f81a-4f5b-8c17-7ac76bb6eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f285c8e-f81a-4f5b-8c17-7ac76bb6eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378000001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b94479-027c-4466-a8ed-6be4271c1dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:02Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f322cd9-aa76-4efb-a2f5-ab7738425e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f322cd9-aa76-4efb-a2f5-ab7738425e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308da57b-8d97-4e3e-a205-86565b9dd273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308da57b-8d97-4e3e-a205-86565b9dd273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b94479-027c-4466-a8ed-6be4271c1dcb', 'volume_name': 'volume-85b94479-027c-4466-a8ed-6be4271c1dcb', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f5ade9-1fdd-4d50-8bc3-4fca14b86141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f5ade9-1fdd-4d50-8bc3-4fca14b86141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b420cd6-cd59-483e-90c6-3a67fd6807f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:01 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume 85b94479-027c-4466-a8ed-6be4271c1dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b94479-027c-4466-a8ed-6be4271c1dcb', 'volume_size': 1} Apr 28 00:04:01 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (69879ea0-b010-4d5f-b41b-b00d8a168c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f9afc8-4dfa-46fa-bf25-bb46fc649d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f9afc8-4dfa-46fa-bf25-bb46fc649d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-41194901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:02Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da446eeb-4a3d-490f-a76a-248a3f76cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da446eeb-4a3d-490f-a76a-248a3f76cfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:02 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9cb67f-5227-4844-b7e6-d381cdcc846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9cb67f-5227-4844-b7e6-d381cdcc846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91', 'volume_name': 'volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3242631b-44bb-4a30-ba7d-6eb573465abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3242631b-44bb-4a30-ba7d-6eb573465abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748a583e-4924-47dc-9c92-7b0239c3deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume 2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91', 'volume_size': 1} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76" returned: 0 in 0.768s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:02 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 is being set with open permissions: ugo+rw Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:02 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 Apr 28 00:04:02 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:02 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e" returned: 0 in 0.758s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:02 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e Apr 28 00:04:02 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (4d80ea47-47cf-43a2-8d8f-60850f9dae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c28757-6f31-4087-ab40-82c84e82410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c28757-6f31-4087-ab40-82c84e82410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1385373894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d240d99c-10bb-431f-861d-c965948ec6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:02Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d67f176-7a5f-4d33-9c70-4cb11d3b5b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d67f176-7a5f-4d33-9c70-4cb11d3b5b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7abc352-d6b2-4f59-9737-d4516418048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7abc352-d6b2-4f59-9737-d4516418048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd240d99c-10bb-431f-861d-c965948ec6e8', 'volume_name': 'volume-d240d99c-10bb-431f-861d-c965948ec6e8', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32351c8e-c0c4-4bb4-bddb-3036760384b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32351c8e-c0c4-4bb4-bddb-3036760384b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f55e9d-2867-4021-ba43-0892d9eff0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:02 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume d240d99c-10bb-431f-861d-c965948ec6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d240d99c-10bb-431f-861d-c965948ec6e8', 'volume_size': 1} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:02 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e" returned: 0 in 0.933s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:02 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e Apr 28 00:04:02 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:02 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76" returned: 0 in 0.540s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:02 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.info Apr 28 00:04:02 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:02 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-e8849be9-f4cd-4d16-964a-5dcfe146be3e" returned: 0 in 0.524s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-e8849be9-f4cd-4d16-964a-5dcfe146be3e" released by "delete_volume" :: held 1.348s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Created reservations ['6f3fb7b8-bee1-41a5-8582-c13de6fa6f37', '4183bb7c-c7df-44f2-ab3d-ec04a3584ade', 'f358d963-f7f8-4018-b1b6-349783251884', 'b52a83c7-6870-4796-bb26-accfe92b58cb'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:02 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:03 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:03 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:03 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-03b4674a-dbbb-4deb-b945-12635ad0376e" returned: 0 in 0.510s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-03b4674a-dbbb-4deb-b945-12635ad0376e" released by "delete_volume" :: held 1.503s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created reservations ['2208d346-cdfa-4276-930c-ee2d29ce58bf', '41ae2ee0-2b61-4659-a841-81059b5f02c5', 'c3ec93c4-1c44-48ec-b8b6-00b6a7ca6118', '12d41f7f-d344-4379-a1cf-e4fe8443b1d6'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:03 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:03 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:03 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.info" returned: 0 in 0.488s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:03 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.info is being set with open permissions: ugo+rw Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:03 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.info Apr 28 00:04:03 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:03 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.515s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:03 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Deleted volume successfully. Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-01e80bce-237d-4541-999e-87b65ea62090 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-e8849be9-f4cd-4d16-964a-5dcfe146be3e-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-34938e93-d94b-4783-a3c2-f52a067907bc-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-34938e93-d94b-4783-a3c2-f52a067907bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-quobyte-8704aac5-5663-4b6f-adcc-1accd8268b03" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-8704aac5-5663-4b6f-adcc-1accd8268b03" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-quobyte-34938e93-d94b-4783-a3c2-f52a067907bc" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:03 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.522s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:03 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Deleted volume successfully. Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-34938e93-d94b-4783-a3c2-f52a067907bc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Deleting offline snapshot 34938e93-d94b-4783-a3c2-f52a067907bc of volume 8704aac5-5663-4b6f-adcc-1accd8268b03 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:04:03 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] snapshot_file for this snap is: volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.info" returned: 0 in 0.518s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.967s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8271c58d-467e-412a-93e4-ec2f181f53d6]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.719s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1699074581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3c06b4-e20e-4732-959b-ba7a99d33c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:01Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Creating volume ac3c06b4-e20e-4732-959b-ba7a99d33c2b {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:04:03 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:03 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b 1073741824 Apr 28 00:04:03 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:03 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2a169d0f-a054-482b-ba7b-f7c960958db4 tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-03b4674a-dbbb-4deb-b945-12635ad0376e-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:03 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-3ff0de80-a480-4a6b-8d04-4d19525f35aa tempest-SnapshotDependencyTests-774724892 None] Create snapshot completed successfully Apr 28 00:04:03 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc Apr 28 00:04:03 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Flow 'volume_create_manager' (a1770d00-534a-4b89-a159-8f2653880537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f12272a-2aad-4bf9-9f14-a042ccccc137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f12272a-2aad-4bf9-9f14-a042ccccc137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-10094893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ccb17e5-8830-4073-a52c-06f1109f8d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de53300844a6428281a8591d6ee15089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:04Z,use_quota=True,user_id='78de2580b3354e53b50d4b1db46f5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff98ae4-1ae5-451e-befd-24511ac2cc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff98ae4-1ae5-451e-befd-24511ac2cc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481aade4-3bab-422c-8277-406b76a6ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481aade4-3bab-422c-8277-406b76a6ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ccb17e5-8830-4073-a52c-06f1109f8d0b', 'volume_name': 'volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551f8202-65f5-48c7-9ed5-456ee876a86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551f8202-65f5-48c7-9ed5-456ee876a86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff0ecc8-c28f-458d-9574-bf28f73ebf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Volume 1ccb17e5-8830-4073-a52c-06f1109f8d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b', 'volume_size': 1} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:04 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc" returned: 0 in 0.576s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8704aac5-5663-4b6f-adcc-1accd8268b03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94b1c29-42fb-440a-840f-77e92c52e92a]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:04 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b 1073741824" returned: 0 in 0.693s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=132,cinder:UPDATE=164,cinder:DELETE=18,cinder:INSERT=52 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:UPDATE=175,cinder:DELETE=15,cinder:SELECT=123,cinder:INSERT=26 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:04:04 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 Apr 28 00:04:04 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:04 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b Apr 28 00:04:04 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Flow 'volume_create_manager' (444a5093-e3b0-4539-b2e7-fce2c38438db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fc51d6-96e7-43fb-99c9-29a954c49152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fc51d6-96e7-43fb-99c9-29a954c49152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813608ab-eaaa-40e3-80bb-4dd4c35d706e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07659edfca434294a526674b2d460c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=64510671-8c7d-4f12-85f4-7273c92b5d76,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:05Z,use_quota=True,user_id='309caa5f254448e98b42d99dd74c161f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f146a0-0fcc-4db1-bbe2-2df07334ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f146a0-0fcc-4db1-bbe2-2df07334ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b5cb83-683a-4f02-9f92-3e26f2fadee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b5cb83-683a-4f02-9f92-3e26f2fadee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '813608ab-eaaa-40e3-80bb-4dd4c35d706e', 'volume_name': 'volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e', 'volume_size': 1, 'snapshot_id': '64510671-8c7d-4f12-85f4-7273c92b5d76'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c74818b-0b9a-45b3-9584-61ea81634d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c74818b-0b9a-45b3-9584-61ea81634d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffea177-8811-4bc2-8746-a573cf7c7ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:04 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Volume 813608ab-eaaa-40e3-80bb-4dd4c35d706e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e', 'volume_size': 1, 'snapshot_id': '64510671-8c7d-4f12-85f4-7273c92b5d76'} Apr 28 00:04:04 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:05 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03" returned: 0 in 0.613s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:05 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc Apr 28 00:04:05 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:05 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b" returned: 0 in 0.560s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.706s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-735946290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54abf43d-dad3-4612-afbb-6ff486841d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:01Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Creating volume 54abf43d-dad3-4612-afbb-6ff486841d50 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:04:05 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b3d15e-5fc9-4e6f-a96c-328c94d19292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e035bb9f-7d66-47e7-aa05-319f81d243ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:05 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50 1073741824 Apr 28 00:04:05 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:05 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b (ac3c06b4-e20e-4732-959b-ba7a99d33c2b): created successfully Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e035bb9f-7d66-47e7-aa05-319f81d243ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (b7342c71-847e-47b1-a6d2-b827eeffddd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:05 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-4bd5c22f-b426-4483-8024-b2ef621bf4c8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created volume successfully. Apr 28 00:04:05 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc" returned: 0 in 0.551s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:05 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc Apr 28 00:04:05 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:05 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50 1073741824" returned: 0 in 0.705s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:05 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:05 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50 Apr 28 00:04:05 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:06 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03.34938e93-d94b-4783-a3c2-f52a067907bc" returned: 0 in 0.462s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-34938e93-d94b-4783-a3c2-f52a067907bc" released by "_delete_snapshot" :: held 2.346s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-8704aac5-5663-4b6f-adcc-1accd8268b03" released by "delete_snapshot" :: held 2.385s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created reservations ['35fdae5e-dc57-4297-9e3b-79d5f1b8ab5f', '5f07b3e7-f91c-4e15-b679-18ac52d7d1de', '3edb90ef-69cb-4479-a589-0f87e81a348f', '11438a3c-693d-4ec4-a768-fca1a9e34897'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Delete snapshot completed successfully. Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e9da4efc-60e7-4c7c-b302-74ceae07864c tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-34938e93-d94b-4783-a3c2-f52a067907bc-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:06 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50" returned: 0 in 0.452s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.420s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378000001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b94479-027c-4466-a8ed-6be4271c1dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:02Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Creating volume 85b94479-027c-4466-a8ed-6be4271c1dcb {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:04:06 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1404ef3a-8c2e-4dee-bddd-bc71f210a00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54abf43d-dad3-4612-afbb-6ff486841d50', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:06 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb 1073741824 Apr 28 00:04:06 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea074bd1-a423-42c0-8117-582cc4da4beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:06 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume volume-54abf43d-dad3-4612-afbb-6ff486841d50 (54abf43d-dad3-4612-afbb-6ff486841d50): created successfully Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea074bd1-a423-42c0-8117-582cc4da4beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (ca74c185-0fc7-4549-b450-d089afb9f370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:06 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-784d9f27-412d-47e3-b939-4e7d0e842400 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created volume successfully. Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-8704aac5-5663-4b6f-adcc-1accd8268b03-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:06 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-8704aac5-5663-4b6f-adcc-1accd8268b03-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "cinder-quobyte-8704aac5-5663-4b6f-adcc-1accd8268b03" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-8704aac5-5663-4b6f-adcc-1accd8268b03" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e19bb6-e250-4689-abcb-33a7818a5ffb]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:07 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb 1073741824" returned: 0 in 0.680s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:07 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb Apr 28 00:04:07 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:07 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 Apr 28 00:04:07 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:07 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb" returned: 0 in 0.443s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.308s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-41194901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:02Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Creating volume 2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:04:07 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:07 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:07 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 1073741824 Apr 28 00:04:07 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b420cd6-cd59-483e-90c6-3a67fd6807f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b94479-027c-4466-a8ed-6be4271c1dcb', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:07 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03 Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5759f0f-d124-4f8a-9efc-37e324b28049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:07 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:07 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume volume-85b94479-027c-4466-a8ed-6be4271c1dcb (85b94479-027c-4466-a8ed-6be4271c1dcb): created successfully Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5759f0f-d124-4f8a-9efc-37e324b28049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:07 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (339741d3-dd8c-4087-b83d-c68090e5fba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:07 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7885e1e5-d29c-41df-8f32-1c8b465bfbc8 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created volume successfully. Apr 28 00:04:08 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-8704aac5-5663-4b6f-adcc-1accd8268b03" returned: 0 in 0.497s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-quobyte-8704aac5-5663-4b6f-adcc-1accd8268b03" released by "delete_volume" :: held 1.067s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Created reservations ['79d9c8bf-f55d-4d89-9a42-811838fecec6', '18715305-bf8a-45bf-a5ac-4dccccc8f604', 'ee4bea0e-acba-4832-a23b-317980dda7db', '11d4b59f-6ffc-4ea1-a011-635d334757ff'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:08 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:08 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:08 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 1073741824" returned: 0 in 0.702s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:08 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 Apr 28 00:04:08 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:08 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.460s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:08 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Deleted volume successfully. Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-ca48d9e5-b6dc-4870-9f4d-6898fdaa6aca tempest-CreateVolumesFromSnapshotTest-1123364225 None] Lock "cinder-8704aac5-5663-4b6f-adcc-1accd8268b03-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:08 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91" returned: 0 in 0.437s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.184s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1385373894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d240d99c-10bb-431f-861d-c965948ec6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb9ec78040a4a86976638d9685c56cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:02Z,use_quota=True,user_id='ce0a3ab9713f4b43a9df3929e5f15eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Creating volume d240d99c-10bb-431f-861d-c965948ec6e8 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:04:08 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748a583e-4924-47dc-9c92-7b0239c3deee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee2244d-cdd2-40e0-9cfb-2cad15ebc277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:08 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8 1073741824 Apr 28 00:04:08 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:08 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 (2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91): created successfully Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee2244d-cdd2-40e0-9cfb-2cad15ebc277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:08 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (69879ea0-b010-4d5f-b41b-b00d8a168c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:08 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-16b1f07f-13ed-411c-bb88-edaa6aa4ded9 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created volume successfully. Apr 28 00:04:09 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8 1073741824" returned: 0 in 0.635s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:09 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8 Apr 28 00:04:09 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:09 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8" returned: 0 in 0.471s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.813s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-10094893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ccb17e5-8830-4073-a52c-06f1109f8d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de53300844a6428281a8591d6ee15089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:04Z,use_quota=True,user_id='78de2580b3354e53b50d4b1db46f5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Creating volume 1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:04:09 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f55e9d-2867-4021-ba43-0892d9eff0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d240d99c-10bb-431f-861d-c965948ec6e8', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:09 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b 1073741824 Apr 28 00:04:09 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6129fc3a-27c4-4158-8028-329391cacefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:09 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Volume volume-d240d99c-10bb-431f-861d-c965948ec6e8 (d240d99c-10bb-431f-861d-c965948ec6e8): created successfully Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6129fc3a-27c4-4158-8028-329391cacefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:09 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Flow 'volume_create_manager' (4d80ea47-47cf-43a2-8d8f-60850f9dae42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:09 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5dbbe7f0-1d95-4a91-89ac-e807e38f5ceb tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created volume successfully. Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-d240d99c-10bb-431f-861d-c965948ec6e8-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-d240d99c-10bb-431f-861d-c965948ec6e8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-quobyte-d240d99c-10bb-431f-861d-c965948ec6e8" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-d240d99c-10bb-431f-861d-c965948ec6e8" acquired by "delete_volume" :: waited 0.047s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[7117b197-fce1-4643-acba-0dcdb06d4a5c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:10 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8 Apr 28 00:04:10 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:10 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b 1073741824" returned: 0 in 0.768s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:10 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b Apr 28 00:04:10 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:10 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8" returned: 0 in 0.654s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:10 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:10 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8 Apr 28 00:04:10 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:11 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b" returned: 0 in 0.514s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.239s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "cinder-quobyte-64510671-8c7d-4f12-85f4-7273c92b5d76-813608ab-eaaa-40e3-80bb-4dd4c35d706e" by "_create_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-64510671-8c7d-4f12-85f4-7273c92b5d76-813608ab-eaaa-40e3-80bb-4dd4c35d706e" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Creating volume 813608ab-eaaa-40e3-80bb-4dd4c35d706e from snapshot 64510671-8c7d-4f12-85f4-7273c92b5d76 {{(pid=81312) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "cinder-quobyte-813608ab-eaaa-40e3-80bb-4dd4c35d706e" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff0ecc8-c28f-458d-9574-bf28f73ebf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e29220-fc3b-48c7-8d50-1e8a6003790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:11 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Volume volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b (1ccb17e5-8830-4073-a52c-06f1109f8d0b): created successfully Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e29220-fc3b-48c7-8d50-1e8a6003790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Flow 'volume_create_manager' (a1770d00-534a-4b89-a159-8f2653880537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-813608ab-eaaa-40e3-80bb-4dd4c35d706e" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] snapshot: 64510671-8c7d-4f12-85f4-7273c92b5d76, volume: 813608ab-eaaa-40e3-80bb-4dd4c35d706e, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:11 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7a4f3cea-5fea-41bf-8574-a0e90aac5905 tempest-VolumeDependencyTests-1699532391 None] Created volume successfully. Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f077ac-7bf9-4e24-8cea-d23c1d340374]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:11 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 Apr 28 00:04:11 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:11 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d240d99c-10bb-431f-861d-c965948ec6e8" returned: 0 in 0.630s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-d240d99c-10bb-431f-861d-c965948ec6e8" released by "delete_volume" :: held 1.365s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created reservations ['739670ea-5726-4266-b3bd-841ad5a8ea9d', 'd0866288-8e72-4fdc-b561-18be0161d671', '9d652124-01fb-4dbf-89e5-5a91196d6274', '3ff7ae9c-5c4d-4c11-92a0-c166167a6b13'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:11 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:11 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Flow 'volume_create_manager' (e1a327e3-0c8f-45ad-930a-2e3f41ae342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c47b24c-14ad-4cff-8e8f-4693e636031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c47b24c-14ad-4cff-8e8f-4693e636031f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a4b92e-9bf4-420d-be13-54412291ef96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fa9269deda41adaccc31eabcc5039c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:12Z,use_quota=True,user_id='41ac309de7284b33a1b9dcb4eefcf88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f5db2a-dace-4d2f-a459-2ba6256343b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f5db2a-dace-4d2f-a459-2ba6256343b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6936ce62-5d3d-4432-a375-3e5faa45bb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6936ce62-5d3d-4432-a375-3e5faa45bb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a4b92e-9bf4-420d-be13-54412291ef96', 'volume_name': 'volume-94a4b92e-9bf4-420d-be13-54412291ef96', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b1856a-f917-4b2a-89be-5a690b3b5196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b1856a-f917-4b2a-89be-5a690b3b5196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83cdc14-5852-41e2-a6e3-be49edde69ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:11 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Volume 94a4b92e-9bf4-420d-be13-54412291ef96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a4b92e-9bf4-420d-be13-54412291ef96', 'volume_size': 1} Apr 28 00:04:11 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Flow 'volume_create_manager' (c80162f1-2d3d-46a9-afcf-5b78d020ffd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f9c817-e6cb-4098-8c47-ff6c9042fea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f9c817-e6cb-4098-8c47-ff6c9042fea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-215192274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea444fc3-0b48-4b10-8b2e-861fa565fac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de53300844a6428281a8591d6ee15089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1ccb17e5-8830-4073-a52c-06f1109f8d0b,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:12Z,use_quota=True,user_id='78de2580b3354e53b50d4b1db46f5f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927008e8-c0f9-4020-b21a-37d4565e65f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927008e8-c0f9-4020-b21a-37d4565e65f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86c8a37-adde-4b5f-bbd6-33c3dabc1f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86c8a37-adde-4b5f-bbd6-33c3dabc1f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ea444fc3-0b48-4b10-8b2e-861fa565fac1', 'volume_name': 'volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1', 'volume_size': 1, 'source_volid': '1ccb17e5-8830-4073-a52c-06f1109f8d0b', 'source_volstatus': 'available'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5efd26-b61e-4093-8e18-fdc600d96195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5efd26-b61e-4093-8e18-fdc600d96195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59284c0d-199c-436f-ba74-8548ffb7d854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:12 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Volume ea444fc3-0b48-4b10-8b2e-861fa565fac1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1', 'volume_size': 1, 'source_volid': '1ccb17e5-8830-4073-a52c-06f1109f8d0b', 'source_volstatus': 'available'} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:12 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76" returned: 0 in 0.748s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64f3ce0-0ad2-4bde-84f3-98bce772b805]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:12 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e Apr 28 00:04:12 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:12 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.535s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:12 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Deleted volume successfully. Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-2283fc08-9a2d-4a87-9b47-1b0f27c56a31 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-d240d99c-10bb-431f-861d-c965948ec6e8-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-quobyte-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91" acquired by "delete_volume" :: waited 0.013s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ffa7c6-7565-40be-bfc2-3ab41af005a9]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:12 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 Apr 28 00:04:12 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:12 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" returned: 0 in 0.582s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 00:04:12 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:12 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e Apr 28 00:04:12 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:13 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91" returned: 0 in 0.566s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:13 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91 Apr 28 00:04:13 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:13 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91" returned: 0 in 0.590s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91" released by "delete_volume" :: held 1.204s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created reservations ['9e628e00-3da2-4365-990d-33b62327070e', '03042cad-b644-471b-a922-884dccec42a3', 'fcdc8046-6e99-422c-b808-39a93eee777f', '27596c91-be61-4d69-a222-ab3eac6967fe'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:13 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:13 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:13 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-85b94479-027c-4466-a8ed-6be4271c1dcb-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-85b94479-027c-4466-a8ed-6be4271c1dcb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:14 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-quobyte-85b94479-027c-4466-a8ed-6be4271c1dcb" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-85b94479-027c-4466-a8ed-6be4271c1dcb" acquired by "delete_volume" :: waited 0.028s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:15 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c7a6e2-e850-4d5e-88f5-2b6cfec61a05]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:15 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:15 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 1.376s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:15 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:15 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Deleted volume successfully. Apr 28 00:04:15 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb Apr 28 00:04:15 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:15 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f32adf0b-3e9c-484d-b3b0-3cc6c1a282c3 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-2c27ad4a-b6dd-4e6a-ac8d-2f8e59ca0c91-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:16 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb" returned: 0 in 1.415s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:16 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:16 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb Apr 28 00:04:16 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:17 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-85b94479-027c-4466-a8ed-6be4271c1dcb" returned: 0 in 0.777s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:17 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-85b94479-027c-4466-a8ed-6be4271c1dcb" released by "delete_volume" :: held 2.280s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:17 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created reservations ['3d45568a-bbc5-451a-a0c8-00fd77ec490f', '6c383432-9f21-4947-ab07-7cfc821d088b', 'ef5784ec-8e9a-493c-858c-b9a124f4b825', 'a6194454-0766-409b-96d4-4289ec256483'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:17 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:17 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:17 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:17 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:18 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.728s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-54abf43d-dad3-4612-afbb-6ff486841d50-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:18 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Deleted volume successfully. Apr 28 00:04:18 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e" returned: 0 in 5.538s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-1025b4f1-db88-470a-be6d-f616954bb7af tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-85b94479-027c-4466-a8ed-6be4271c1dcb-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-54abf43d-dad3-4612-afbb-6ff486841d50-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fdb635-58c7-4e1c-a357-6ab36539a037]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-quobyte-54abf43d-dad3-4612-afbb-6ff486841d50" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-54abf43d-dad3-4612-afbb-6ff486841d50" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5d6437-f2bd-4cb2-84aa-ce1d8f106b6c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:18 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e Apr 28 00:04:18 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:18 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50 Apr 28 00:04:18 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:18 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:18 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:18 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50 Apr 28 00:04:18 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:19 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" returned: 0 in 0.701s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 00:04:19 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Converted 1024.00 MB image at 184.63 MB/s Apr 28 00:04:19 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e is being set with open permissions: ugo+rw Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:19 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e Apr 28 00:04:19 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:19 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-54abf43d-dad3-4612-afbb-6ff486841d50" returned: 0 in 0.443s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-54abf43d-dad3-4612-afbb-6ff486841d50" released by "delete_volume" :: held 1.021s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created reservations ['1b68c0f9-5ea8-40f1-b1a8-a94043e15aff', 'c347c338-0c90-4218-bd02-575d9f2a9250', 'c49e48a7-e4ef-4d54-9dab-48b3bbb53374', '34b7eed0-8098-4fb7-b93e-acc838f5c970'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:19 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:19 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:19 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e" returned: 0 in 0.514s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-813608ab-eaaa-40e3-80bb-4dd4c35d706e" released by "_copy_volume_from_snapshot" :: held 8.237s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-64510671-8c7d-4f12-85f4-7273c92b5d76-813608ab-eaaa-40e3-80bb-4dd4c35d706e" released by "_create_volume_from_snapshot" :: held 8.309s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.333s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.582s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a4b92e-9bf4-420d-be13-54412291ef96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fa9269deda41adaccc31eabcc5039c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:12Z,use_quota=True,user_id='41ac309de7284b33a1b9dcb4eefcf88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Creating volume 94a4b92e-9bf4-420d-be13-54412291ef96 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:04:19 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:19 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96 1073741824 Apr 28 00:04:19 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffea177-8811-4bc2-8746-a573cf7c7ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e', 'volume_size': 1, 'snapshot_id': '64510671-8c7d-4f12-85f4-7273c92b5d76'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8353820b-9278-4818-b93b-9a4d3f3340ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:19 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Volume volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e (813608ab-eaaa-40e3-80bb-4dd4c35d706e): created successfully Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8353820b-9278-4818-b93b-9a4d3f3340ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Flow 'volume_create_manager' (444a5093-e3b0-4539-b2e7-fce2c38438db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:19 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-88f2d8e2-18d5-4f37-8408-bc4d7f5f72be tempest-SnapshotDependencyTests-774724892 None] Created volume successfully. Apr 28 00:04:19 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.425s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:19 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Deleted volume successfully. Apr 28 00:04:19 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-6cea4213-32d4-431c-910a-4f507f755c78 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-54abf43d-dad3-4612-afbb-6ff486841d50-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:20 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96 1073741824" returned: 0 in 0.641s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:20 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96 Apr 28 00:04:20 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "cinder-64510671-8c7d-4f12-85f4-7273c92b5d76-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-64510671-8c7d-4f12-85f4-7273c92b5d76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "cinder-quobyte-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "cinder-quobyte-64510671-8c7d-4f12-85f4-7273c92b5d76" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-64510671-8c7d-4f12-85f4-7273c92b5d76" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Deleting offline snapshot 64510671-8c7d-4f12-85f4-7273c92b5d76 of volume d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] snapshot_file for this snap is: volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6122570e-2d3a-4037-8f4a-8193fd6b53d7]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-ac3c06b4-e20e-4732-959b-ba7a99d33c2b-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-ac3c06b4-e20e-4732-959b-ba7a99d33c2b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-quobyte-ac3c06b4-e20e-4732-959b-ba7a99d33c2b" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:20 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 Apr 28 00:04:20 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-ac3c06b4-e20e-4732-959b-ba7a99d33c2b" acquired by "delete_volume" :: waited 0.026s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdf9e90-35c8-48d7-9c6b-d62fd0c2156c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:20 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b Apr 28 00:04:20 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:20 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96" returned: 0 in 0.558s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.679s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:20 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Cloning volume 1ccb17e5-8830-4073-a52c-06f1109f8d0b to volume ea444fc3-0b48-4b10-8b2e-861fa565fac1 Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83cdc14-5852-41e2-a6e3-be49edde69ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a4b92e-9bf4-420d-be13-54412291ef96', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bbdbc9-b076-43df-9fbc-9a422c170f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Creating offline snapshot 6d84942e-24b1-4927-b94c-2dbd04dc4522 of volume 1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:04:20 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Volume volume-94a4b92e-9bf4-420d-be13-54412291ef96 (94a4b92e-9bf4-420d-be13-54412291ef96): created successfully Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bbdbc9-b076-43df-9fbc-9a422c170f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Flow 'volume_create_manager' (e1a327e3-0c8f-45ad-930a-2e3f41ae342c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55777c8-d29d-4299-9988-84671b2d2356]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:20 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:20 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-11ec137c-5dcd-4547-a49b-4f8d498374bb tempest-CinderUnicodeTest-739400943 None] Created volume successfully. Apr 28 00:04:20 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b Apr 28 00:04:20 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:21 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76" returned: 0 in 0.633s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1dfee0-c0ff-4040-8df8-ec6accfcb725]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:21 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b" returned: 0 in 0.543s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:21 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b Apr 28 00:04:21 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:21 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e Apr 28 00:04:21 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:21 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b" returned: 0 in 0.595s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:21 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 1G Apr 28 00:04:21 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:21 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ac3c06b4-e20e-4732-959b-ba7a99d33c2b" returned: 0 in 0.496s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-ac3c06b4-e20e-4732-959b-ba7a99d33c2b" released by "delete_volume" :: held 1.079s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created reservations ['036115b4-2934-42e1-9cbd-3a81d8b7bff5', '919be58b-21e7-451e-b031-5c08da38c1af', 'bca52448-e4f6-4d18-90b3-a7fdf04f4eb7', '61e4f956-794f-4398-88f6-23641e437548'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:21 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" returned: 0 in 0.659s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:21 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 Apr 28 00:04:21 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:21 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:21 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:21 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81312) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Flow 'volume_create_manager' (fc3d6169-c010-4a36-a984-0c41db7030ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a50e30-982c-435e-9f57-3dfd1f436769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a50e30-982c-435e-9f57-3dfd1f436769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1321398593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067bb2f4-0112-4959-a6a5-d17ccb165506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fa9269deda41adaccc31eabcc5039c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:22Z,use_quota=True,user_id='41ac309de7284b33a1b9dcb4eefcf88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30e40d7-5e25-4688-b453-795c9257e9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30e40d7-5e25-4688-b453-795c9257e9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:22 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77688aa3-0f8f-4eb9-b9f0-95c79cef4873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77688aa3-0f8f-4eb9-b9f0-95c79cef4873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '067bb2f4-0112-4959-a6a5-d17ccb165506', 'volume_name': 'volume-067bb2f4-0112-4959-a6a5-d17ccb165506', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc509aaa-0f54-4eed-a61c-213238cc6ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc509aaa-0f54-4eed-a61c-213238cc6ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd160a4-acdc-4a36-83ad-354bef736f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:22 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Volume 067bb2f4-0112-4959-a6a5-d17ccb165506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-067bb2f4-0112-4959-a6a5-d17ccb165506', 'volume_size': 1} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 1G" returned: 0 in 0.775s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:22 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 Apr 28 00:04:22 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:22 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:22 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Deleted volume successfully. Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-0363e892-b9e7-4ca3-9768-152f1a763409 tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-ac3c06b4-e20e-4732-959b-ba7a99d33c2b-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:22 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76" returned: 0 in 0.662s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:22 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76 Apr 28 00:04:22 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:22 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522" returned: 0 in 0.513s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:22 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 is being set with open permissions: ugo+rw Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:22 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 Apr 28 00:04:22 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-71cc3b15-76e4-4473-ac0d-604860587809-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-71cc3b15-76e4-4473-ac0d-604860587809-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "cinder-quobyte-71cc3b15-76e4-4473-ac0d-604860587809" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-71cc3b15-76e4-4473-ac0d-604860587809" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7a30ab-2fd2-46ad-ac50-75723c88a753]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:22 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:22 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e.64510671-8c7d-4f12-85f4-7273c92b5d76" returned: 0 in 0.514s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:23 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809 Apr 28 00:04:23 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-64510671-8c7d-4f12-85f4-7273c92b5d76" released by "_delete_snapshot" :: held 2.571s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" released by "delete_snapshot" :: held 2.602s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Created reservations ['40ab7242-09cb-48c2-a45a-7aa86c3f304c', '876c1ecb-2e2d-4630-8874-d1bc823ed5df', 'fada7077-2188-44de-91a3-7f51c89b0e57', 'd39682ce-26d4-4a21-89cf-c3a2610a0760'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:23 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Delete snapshot completed successfully. Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e3396692-b088-47b4-a447-de6ec0e44ad4 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-64510671-8c7d-4f12-85f4-7273c92b5d76-delete_snapshot" released by "delete_snapshot" :: held 2.794s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:23 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522" returned: 0 in 0.545s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:23 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.info Apr 28 00:04:23 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:23 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809" returned: 0 in 0.562s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:23 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809 Apr 28 00:04:23 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "cinder-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "cinder-quobyte-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[649dfd7f-f181-4006-b822-4558de48d917]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:23 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e Apr 28 00:04:23 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:23 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.info" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:23 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.info is being set with open permissions: ugo+rw Apr 28 00:04:23 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:23 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.info Apr 28 00:04:23 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:24 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-71cc3b15-76e4-4473-ac0d-604860587809" returned: 0 in 0.508s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-quobyte-71cc3b15-76e4-4473-ac0d-604860587809" released by "delete_volume" :: held 1.106s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Created reservations ['bc8f7d76-a0ee-43f8-ab36-a0cb8c6127e7', '16a30439-1641-41c8-9240-6e4c7f006102', 'cdc5b145-14b8-43de-91c1-9db83dc1a7bd', '694c72d1-d92a-4276-9dd6-e6303d8b34bd'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:24 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:24 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:24 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" returned: 0 in 0.610s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:24 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.info" returned: 0 in 0.505s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:24 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e Apr 28 00:04:24 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-ea444fc3-0b48-4b10-8b2e-861fa565fac1" by "_copy_volume_from_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-ea444fc3-0b48-4b10-8b2e-861fa565fac1" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] snapshot: 6d84942e-24b1-4927-b94c-2dbd04dc4522, volume: ea444fc3-0b48-4b10-8b2e-861fa565fac1, {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e581fe3-d650-449e-8d8c-02850d93c627]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:24 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 Apr 28 00:04:24 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:24 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.436s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:24 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Deleted volume successfully. Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5648c2d6-529d-4baa-8318-45460c42511b tempest-CreateVolumesFromSourceVolumeTest-1803084975 None] Lock "cinder-71cc3b15-76e4-4473-ac0d-604860587809-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:24 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" returned: 0 in 0.491s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e" released by "delete_volume" :: held 1.157s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Created reservations ['78350d43-95da-484b-ad82-62f789cc908d', 'a3d51974-2df8-45cd-9547-04e6458e369f', '183bf9a9-122e-40fc-9581-a9940a23ea8a', '94296006-17a7-4a13-a5ee-f3f693188f38'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:24 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:25 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:25 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:25 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522" returned: 0 in 0.581s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Creating direct copy from snapshot {{(pid=81312) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e99b866-256c-4ee5-a265-bd89cefa966d]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:25 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b Apr 28 00:04:25 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:25 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.514s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:25 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Deleted volume successfully. Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-5957fc76-7294-4194-8740-a42da7cf2aed tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-d22d2e4c-9ec6-4b31-ad8e-717e1959be5e-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:25 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b" returned: 0 in 0.614s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.utils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Path /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 not found in is_blk_device check {{(pid=81312) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:25 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 Apr 28 00:04:25 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "cinder-813608ab-eaaa-40e3-80bb-4dd4c35d706e-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-813608ab-eaaa-40e3-80bb-4dd4c35d706e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "cinder-quobyte-813608ab-eaaa-40e3-80bb-4dd4c35d706e" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:25 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-813608ab-eaaa-40e3-80bb-4dd4c35d706e" acquired by "delete_volume" :: waited 0.014s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:26 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0680fb1-d04e-4eb1-8744-c08de573fbea]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:26 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e Apr 28 00:04:26 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:26 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e" returned: 0 in 0.904s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:26 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:26 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e Apr 28 00:04:26 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:27 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:27 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-813608ab-eaaa-40e3-80bb-4dd4c35d706e" returned: 0 in 0.954s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:27 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-quobyte-813608ab-eaaa-40e3-80bb-4dd4c35d706e" released by "delete_volume" :: held 1.928s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:28 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Created reservations ['df00c448-9ae1-4d56-ab95-f65a337cea85', '36e31325-6ae7-4abb-8c43-159964c15516', 'e6b3a142-6e48-417f-b35c-b3edc9cf5dad', 'bbc1d1a2-e684-4df0-ae7a-c63133f39963'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:28 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:28 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:28 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:28 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:29 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:29 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.909s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:29 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:29 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Deleted volume successfully. Apr 28 00:04:29 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-c6a9b5b3-9fd8-4040-9389-53614799e2c2 tempest-SnapshotDependencyTests-774724892 None] Lock "cinder-813608ab-eaaa-40e3-80bb-4dd4c35d706e-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:31 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1" returned: 0 in 5.527s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:31 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ffc182-5311-4d5d-8041-1c22478486cb]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:31 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b Apr 28 00:04:31 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:31 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b" returned: 0 in 0.708s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:31 devstack cinder-volume[81312]: DEBUG cinder.image.image_utils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Image conversion details: src /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 {{(pid=81312) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 00:04:31 devstack cinder-volume[81312]: INFO cinder.image.image_utils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Converted 1024.00 MB image at 185.23 MB/s Apr 28 00:04:31 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 is being set with open permissions: ugo+rw Apr 28 00:04:31 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:31 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 Apr 28 00:04:31 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:32 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1" returned: 0 in 0.517s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-ea444fc3-0b48-4b10-8b2e-861fa565fac1" released by "_copy_volume_from_snapshot" :: held 8.029s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-6d84942e-24b1-4927-b94c-2dbd04dc4522" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:32 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-6d84942e-24b1-4927-b94c-2dbd04dc4522" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:32 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Deleting offline snapshot 6d84942e-24b1-4927-b94c-2dbd04dc4522 of volume 1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:04:32 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] snapshot_file for this snap is: volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:04:32 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb29bdde-b02b-4e95-b770-5b054a45d1a5]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:32 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:32 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 Apr 28 00:04:32 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:33 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522" returned: 0 in 0.565s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:33 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:04:33 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c15842-d0ce-4d59-ac7e-05ca499fdb72]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:33 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b Apr 28 00:04:33 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:33 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b" returned: 0 in 0.574s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:33 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:33 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 Apr 28 00:04:33 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:34 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522" returned: 0 in 0.560s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:34 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522 Apr 28 00:04:34 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:34 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b.6d84942e-24b1-4927-b94c-2dbd04dc4522" returned: 0 in 0.475s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-6d84942e-24b1-4927-b94c-2dbd04dc4522" released by "_delete_snapshot" :: held 2.272s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.964s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.527s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-27T22:04:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1321398593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067bb2f4-0112-4959-a6a5-d17ccb165506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fa9269deda41adaccc31eabcc5039c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T22:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T22:04:22Z,use_quota=True,user_id='41ac309de7284b33a1b9dcb4eefcf88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79dff977-5179-4908-b451-1ca94af885da),volume_type_id=79dff977-5179-4908-b451-1ca94af885da)}" {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Creating volume 067bb2f4-0112-4959-a6a5-d17ccb165506 {{(pid=81312) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Selected osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 as target Quobyte volume. {{(pid=81312) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 00:04:34 devstack cinder-volume[81312]: INFO cinder.volume.drivers.remotefs [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] casted to osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6 Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 1073741824 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:34 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 1073741824 Apr 28 00:04:34 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59284c0d-199c-436f-ba74-8548ffb7d854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1', 'volume_size': 1, 'source_volid': '1ccb17e5-8830-4073-a52c-06f1109f8d0b', 'source_volstatus': 'available'}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce895ce7-98fd-4bc1-abb9-1a273fe2a672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:34 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Volume volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 (ea444fc3-0b48-4b10-8b2e-861fa565fac1): created successfully Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce895ce7-98fd-4bc1-abb9-1a273fe2a672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:34 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Flow 'volume_create_manager' (c80162f1-2d3d-46a9-afcf-5b78d020ffd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:34 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-167b6456-5c59-46d8-bf9f-a4584b00b7c4 tempest-VolumeDependencyTests-1699532391 None] Created volume successfully. Apr 28 00:04:35 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 1073741824" returned: 0 in 0.713s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:35 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:35 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 Apr 28 00:04:35 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-1ccb17e5-8830-4073-a52c-06f1109f8d0b-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-1ccb17e5-8830-4073-a52c-06f1109f8d0b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-1ccb17e5-8830-4073-a52c-06f1109f8d0b" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:35 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-1ccb17e5-8830-4073-a52c-06f1109f8d0b" acquired by "delete_volume" :: waited 0.019s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b943ff-db48-48b4-bbb9-8ab3100d937f]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:36 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:36 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506" returned: 0 in 0.530s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'} {{(pid=81312) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:36 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd160a4-acdc-4a36-83ad-354bef736f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067bb2f4-0112-4959-a6a5-d17ccb165506', 'volume_size': 1}' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f2746d-28da-4519-905d-d245a6a28eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 00:04:36 devstack cinder-volume[81312]: INFO cinder.volume.flows.manager.create_volume [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Volume volume-067bb2f4-0112-4959-a6a5-d17ccb165506 (067bb2f4-0112-4959-a6a5-d17ccb165506): created successfully Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f2746d-28da-4519-905d-d245a6a28eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81312) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Flow 'volume_create_manager' (fc3d6169-c010-4a36-a984-0c41db7030ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81312) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 00:04:36 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-5c356ff1-2938-4cd4-aff7-5b32e1733507 tempest-CinderUnicodeTest-739400943 None] Created volume successfully. Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Creating offline snapshot c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 of volume 067bb2f4-0112-4959-a6a5-d17ccb165506 {{(pid=81312) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7402b2f-893c-4730-ae57-d67ca3891f32]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:36 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b" returned: 0 in 0.702s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:36 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:36 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 Apr 28 00:04:36 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:36 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b Apr 28 00:04:36 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:37 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-1ccb17e5-8830-4073-a52c-06f1109f8d0b" returned: 0 in 0.507s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-1ccb17e5-8830-4073-a52c-06f1109f8d0b" released by "delete_volume" :: held 1.279s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Created reservations ['d3ec5812-1066-4d7d-83dd-b313b77b0d38', 'd0f22a48-1b24-4cdf-8e6f-9feecac9186a', '3e820323-34b1-43b6-9eb6-f37fb9093167', '05c6a7c0-f321-4fbf-9f68-2df406e9051e'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:37 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506" returned: 0 in 0.663s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 1G {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:37 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 1G Apr 28 00:04:37 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:37 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:37 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:37 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.523s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:37 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Deleted volume successfully. Apr 28 00:04:37 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-e2030099-a080-4374-a5f2-27b090aeeda4 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-1ccb17e5-8830-4073-a52c-06f1109f8d0b-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:38 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 1G" returned: 0 in 0.717s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-067bb2f4-0112-4959-a6a5-d17ccb165506 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:38 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-067bb2f4-0112-4959-a6a5-d17ccb165506 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 Apr 28 00:04:38 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-ea444fc3-0b48-4b10-8b2e-861fa565fac1-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-ea444fc3-0b48-4b10-8b2e-861fa565fac1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-ea444fc3-0b48-4b10-8b2e-861fa565fac1" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-ea444fc3-0b48-4b10-8b2e-861fa565fac1" acquired by "delete_volume" :: waited 0.024s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be42c6d-950b-4c48-bcc3-7d36256685ee]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:38 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 Apr 28 00:04:38 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:38 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-067bb2f4-0112-4959-a6a5-d17ccb165506 -F qcow2 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9" returned: 0 in 0.520s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:38 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 is being set with open permissions: ugo+rw Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:38 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 Apr 28 00:04:38 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:38 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1" returned: 0 in 0.593s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:38 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:38 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1 Apr 28 00:04:38 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:39 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9" returned: 0 in 0.503s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:39 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.info Apr 28 00:04:39 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:39 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-ea444fc3-0b48-4b10-8b2e-861fa565fac1" returned: 0 in 0.459s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-ea444fc3-0b48-4b10-8b2e-861fa565fac1" released by "delete_volume" :: held 1.093s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Created reservations ['ff1c392a-6df7-41e5-950e-347c3319f0ad', '1b1d2c11-5f07-4ef1-b045-b683e49b37df', '27f1e556-a686-4ae3-affd-4d87bb19cd1a', '971299bf-5bd9-4e01-94c0-72a6dad44771'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:39 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:39 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:39 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.info" returned: 0 in 0.463s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:39 devstack cinder-volume[81312]: WARNING cinder.volume.drivers.remotefs [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.info is being set with open permissions: ugo+rw Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.info {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:39 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.info Apr 28 00:04:39 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:39 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.423s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:39 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Deleted volume successfully. Apr 28 00:04:39 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-cfc516e7-9ec0-4ae5-b049-046801dd78a7 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-ea444fc3-0b48-4b10-8b2e-861fa565fac1-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:39 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.info" returned: 0 in 0.448s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.401s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:40 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-b9daa029-1fce-4e5b-b108-80e940649fd0 tempest-CinderUnicodeTest-739400943 None] Create snapshot completed successfully Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-214d0baf-66fc-4214-bcd1-1748d0aad33c-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-214d0baf-66fc-4214-bcd1-1748d0aad33c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "cinder-quobyte-214d0baf-66fc-4214-bcd1-1748d0aad33c" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-214d0baf-66fc-4214-bcd1-1748d0aad33c" acquired by "delete_volume" :: waited 0.018s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2744ed-faf9-4da7-b414-0467fe105c1b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:40 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c Apr 28 00:04:40 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Acquiring lock "cinder-c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9-delete_snapshot" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Lock "cinder-c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Acquiring lock "cinder-quobyte-067bb2f4-0112-4959-a6a5-d17ccb165506" by "delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Lock "cinder-quobyte-067bb2f4-0112-4959-a6a5-d17ccb165506" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Acquiring lock "cinder-quobyte-c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9" by "_delete_snapshot" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Lock "cinder-quobyte-c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Deleting offline snapshot c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 of volume 067bb2f4-0112-4959-a6a5-d17ccb165506 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] snapshot_file for this snap is: volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 {{(pid=81312) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b71881-b9d6-4550-9a48-8c52299ec10b]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:40 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:41 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 Apr 28 00:04:41 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:41 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c" returned: 0 in 0.575s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:41 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c Apr 28 00:04:41 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:41 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9" returned: 0 in 0.538s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.remotefs [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-067bb2f4-0112-4959-a6a5-d17ccb165506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81312) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[787e24f7-009c-4e73-b3be-15796d14355c]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:41 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-214d0baf-66fc-4214-bcd1-1748d0aad33c" returned: 0 in 0.471s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:41 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 Apr 28 00:04:41 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-quobyte-214d0baf-66fc-4214-bcd1-1748d0aad33c" released by "delete_volume" :: held 1.088s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Created reservations ['07c59d19-d219-4ae0-a257-38e9f191e818', '0c806d11-e4a9-408c-9d9e-ffd31caef030', '611d616d-1fd5-4841-8ceb-83e7885dd2e0', '3e647d6a-2aea-4be2-80c3-6546be809e4e'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:41 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:41 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:41 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:42 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506" returned: 0 in 0.557s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:42 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 Apr 28 00:04:42 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:42 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.487s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:42 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:42 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Deleted volume successfully. Apr 28 00:04:42 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f23e73c5-a8bd-4a60-b3d7-9e3e918119b5 tempest-VolumeDependencyTests-1699532391 None] Lock "cinder-214d0baf-66fc-4214-bcd1-1748d0aad33c-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:42 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9" returned: 0 in 0.539s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:42 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:42 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9 Apr 28 00:04:42 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:43 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:43 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506.c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9" returned: 0 in 0.491s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Lock "cinder-quobyte-c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9" released by "_delete_snapshot" :: held 2.238s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Lock "cinder-quobyte-067bb2f4-0112-4959-a6a5-d17ccb165506" released by "delete_snapshot" :: held 2.263s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:43 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Created reservations ['0c5aae05-7b89-4137-8863-0827623d46dd', 'c3dd5e4e-a805-42e1-8afb-3b5ad0e79cfb', 'b62397bd-a22a-49f2-ad03-2f46760706b5', 'fd071ddb-ed12-44cd-9cdc-b58d71c1eb5d'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:43 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Delete snapshot completed successfully. Apr 28 00:04:43 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-f6ed52b2-0e2c-4832-acc9-8ae14d29c3ee tempest-CinderUnicodeTest-739400943 None] Lock "cinder-c9b1bd1d-f367-40c4-9fad-5ebb61edf8a9-delete_snapshot" released by "delete_snapshot" :: held 2.413s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Acquiring lock "cinder-067bb2f4-0112-4959-a6a5-d17ccb165506-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Lock "cinder-067bb2f4-0112-4959-a6a5-d17ccb165506-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Acquiring lock "cinder-quobyte-067bb2f4-0112-4959-a6a5-d17ccb165506" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:44 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Lock "cinder-quobyte-067bb2f4-0112-4959-a6a5-d17ccb165506" acquired by "delete_volume" :: waited 0.016s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:44 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[723f5f5a-05ed-456e-a2ab-12d6253ebf10]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:44 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 Apr 28 00:04:44 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:44 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506" returned: 0 in 0.505s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:44 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:44 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506 Apr 28 00:04:44 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:45 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-067bb2f4-0112-4959-a6a5-d17ccb165506" returned: 0 in 0.429s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Lock "cinder-quobyte-067bb2f4-0112-4959-a6a5-d17ccb165506" released by "delete_volume" :: held 0.997s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_service.periodic_task [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81312) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:45 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:45 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Created reservations ['3a5ef136-eb1f-48ea-a487-19269ec1e693', 'a2686a4b-06f3-450d-a1b9-2e5e415d4d67', 'a1344071-8548-4186-ac6b-72672c510b8d', '6b0b4712-0585-4582-a52f-094d58ae88fd'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:45 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:45 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:45 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.441s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-5d0b22b0-b699-43bc-ac77-0200c49c3944 None None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:45 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.441s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:45 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Deleted volume successfully. Apr 28 00:04:45 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-03a6ec8c-d524-48dd-b72e-dc13fe97c009 tempest-CinderUnicodeTest-739400943 None] Lock "cinder-067bb2f4-0112-4959-a6a5-d17ccb165506-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Acquiring lock "cinder-94a4b92e-9bf4-420d-be13-54412291ef96-delete_volume" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Lock "cinder-94a4b92e-9bf4-420d-be13-54412291ef96-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Acquiring lock "cinder-quobyte-94a4b92e-9bf4-420d-be13-54412291ef96" by "delete_volume" {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 00:04:46 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Lock "cinder-quobyte-94a4b92e-9bf4-420d-be13-54412291ef96" acquired by "delete_volume" :: waited 0.015s {{(pid=81312) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 00:04:46 devstack cinder-volume[81312]: DEBUG oslo.privsep.daemon [-] privsep: reply[278a4fac-dbf1-4d94-a215-92be7cc986a1]: (4, 'qcow2') {{(pid=82167) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 00:04:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:46 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96 Apr 28 00:04:46 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:46 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96" returned: 0 in 0.529s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:46 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:46 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96 Apr 28 00:04:46 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:47 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81/volume-94a4b92e-9bf4-420d-be13-54412291ef96" returned: 0 in 0.438s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Lock "cinder-quobyte-94a4b92e-9bf4-420d-be13-54412291ef96" released by "delete_volume" :: held 1.011s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG cinder.quota [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Created reservations ['55cd66bf-8e48-4de0-b811-5a642cb121af', '2aef4980-bce6-4e47-bb01-d9edc54c3674', '781ea48d-8ad3-4270-975c-71dbbce71f62', '9b381f2c-3f39-407d-8c45-0be6c9c175bf'] {{(pid=81312) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6': None} {{(pid=81312) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG cinder.volume.drivers.quobyte [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0cf555ff-90df-40e2-adce-520f0730e9e6'] {{(pid=81312) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.lockutils [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81312) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 00:04:47 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81 Apr 28 00:04:47 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 00:04:47 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG oslo_concurrency.processutils [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d3df2a0486a98a7daa7d649946353b81" returned: 0 in 0.431s {{(pid=81312) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG cinder.manager [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Notifying Schedulers of capabilities ... {{(pid=81312) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 00:04:47 devstack cinder-volume[81312]: INFO cinder.volume.manager [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Deleted volume successfully. Apr 28 00:04:47 devstack cinder-volume[81312]: DEBUG cinder.coordination [None req-7ab15ea1-89b2-4581-9759-7a563340319b tempest-CinderUnicodeTest-739400943 None] Lock "cinder-94a4b92e-9bf4-420d-be13-54412291ef96-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=81312) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 00:04:57 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:SELECT=106,cinder:INSERT=35,cinder:UPDATE=163,cinder:DELETE=12 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 00:04:57 devstack cinder-volume[81312]: DEBUG dbcounter [-] [81312] Writing DB stats cinder:UPDATE=151,cinder:SELECT=108,cinder:INSERT=45,cinder:DELETE=13 {{(pid=81312) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}